I am able to damage and destroy units of other empires that I have non-agression pacts with while they are in my territory using direct damage spell. I used pilar of flame as the test. Seems like this is a bug, or are we supposed to be able to do this?
Also, pilar of flame was only doing 2 damage. I controlled 1 fire shard so should have been doing 4.