These units appear to be leftover garrison units in the enemy cities. Defeating an enemy sovereign causes the city (and its borders) to disappear, but a unit remains on the location of the main city tile. The unit is selectable but moving into its square does not initiate combat.