[0.77 Bug] Death Shrine for Kingdom player

I was playing a game where I took over an Empire city that was in the process of building a Death Shrine near the city.  The City and territory turned Kingdom colors, but when the Death Shrine finished building, it stayed as a death shrine.  Since I couldn't figure out how to destroy an improvement outside a city, I couldn't remove it or rebuild it as a life shrine.  Is this supposed to happen?  I thought Life/Death shards were supposed to switch back and forth depending on who owned them.