Same problem here. Once a Caravan has established a trade route, I don't want to see it on my bar ever again. I do want to say thanks for having Caravans re-populate/regen themselves after being destroyed, that was a tedious chore I'm happy to live without.