I don't really have a problem with you proving that you can get money out of an AI by declaring war, and then backstab them by making peace. The problem is that you can apparently do this more than once a turn, and without consequences. Rather than messing with the diplomacy too much, I'd have thought the simplest solution would be to have a cool-down period on peace treaties. So in other words, if you make peace there is an enforced 5 turn period where you can't declare on that AI again. It doesn't make a great deal of sense to be declaring war and then making peace multiple times, certainly not in the same turn.
Another way of it doing it would be that the AI could simply refuse to make peace if you keep doing this; "We don't trust you", with a diplomacy penalty with all AIs.
Yet another way of doing it would be for later peace treaties to cost more, again because the AI rightly doesn't trust that you'll keep the peace.