Actually, I don't think it stops... it changes Volume... a LOT. Turn up the volume and load a game and you'll see.
Okay, now that is weird. I set the volume to 100 and the music did not disappear when I loaded a save. Afterwards, I set the volume back to 50, but the music still kept playing when loading. There is something strange going on with the volume-settings.