Yeah I've seen similar behaviour. I'm hoping the 1.2 AI patch will help with this, which the notes say should help with targets of opportunity, i.e. the army may be heading somwhere else, but if they notice something worth getting along the way they should target that.
The notes specifically mention targeting Outposts, but I'm hoping undefended cities will also become targets.