The OP didn't say "remove" the cooldowns, just reduce.
Fireball hurts everybody, yes? So you risk splash damage from that spell. (I have to admit I've never had the opportunity to get deep down the spell trees so I can't really comment on spell power/cooldowns.)
Maybe a case by case basis. I think warrior type abilities should have shorter cooldowns - melee is what these units were trained for after all.