Variety adds to the fun; I'd like it to be possible for all spellcasters to make a mistake. Higher IQ hopefully means less mistakes, right? Getting hit in the middle of casting should increase chances for mistakes.
So impacts of a casting failure: they could lose {some/all}: mana, action points, spell takes effect on you, spell affects your army, spell fires on empty square, spell dissipates, etc.