Hmm, not quite the problems I'm having, but thanks for the replies.
The game isn't unstable- it doesn't crash, or behave in any weird way, and strictly speaking it's not un-playable. I'm just wondering why frames per second on the world map drop from 60 at the start of the game, to mid-20s by the time more than two cities and various creeps are being displayed. It's jerky as anything. I COULD just use the cloth map, but I feel I'd be missing a big part of the game. Scrolling to a less dense area of the map does, of course, make the framerate shoot back up, but it just makes the transition between areas more immersion breaking.
For the record, this is on an i5@4.3,a 560ti, and 8 gigs of RAM. I'm measuring frames per second with FRAPS. Restarting the game doesn't help, either. Nothing abnormal is running in the background.
Cheers!