Caravans at the moment only provide a food bonus. So whether or not you use it on the AI, or on your own city, it does not matter. Hopefully, with time it can provide more bonuses, but basically if you hover your mouse over the caravan once it's doing its route, you'll see the % increase in food.
My biggest problems with Caravans right now, is there's no way to protect them from creatures if they get attacked, but someone did mentioned that if you group up the caravan with a little escort before actually establishing the route, the escort stays with the caravan forever, so I still have to try that to see if it works.