Same problem, after killing a sovereign, their old units remain in place and can't be attacked. The spiders are a little stranger.. every time I move onto one, I attack it, but when they move onto me they only 'sometimes' attack. That is, I've had them attack my sovereign sometimes, and at other times they move right through him without initiating combat, or even end their turn on top of him without attacking. But I haven't (yet) seen a spider get bugged so that it can't be attacked, not like the leftover units of a dead sovereign.