The game didn't crash. It was one of those times that it froze when I hit the end turn button. I tend to give it about 5 minutes of "freeze" time to see if it's just taking a long time to do something. But part of the way I can tell it's locked up is it won't let me bring up the Options with Esc or scroll the map by moving the cursor to the edge.
The issue with the buildings stuck in construction limbo though happen after I loaded the game and I can seem to play it fine otherwise. I'm not sure if when it froze it was in the process of auto-saving and maybe the save file got corrupted and that is the source of the bug. Though if that were the case I would of thought it wouldn't load at all with a corrupt file.
It seems like a very specific bug that is effecting different buildings. The Market, Granary, and others I can't remember. But both of those don't have an "upgrade" building type. And it's only in that one city none of the others. Some of my other save game files I put up recently with the crash when I R&D Housing are simply later points in this same game so not sure if that is connected. But even if it's not those buildings are still showing the graphic for "under construction" even though it is now many turns later.