Can you raze a city when you capture it? I play defensively. The one time I ended up invading others, I found myself swamped by unhappiness due to number of cities.
Yes, you can raze any structure in the world; your cities as well as cities that are captured.
I believe that the unrest due to an outside occupying force goes down by a certain percentage each turn. Depending on your strategy, you might want to wait out the occupational unrest to make use of the city (it may have a large number of essence slots).
(please correct if I am wrong, anyone).