Could you actually build more buildings than are in the screenshot? You're not limited to 2 *buildings* in a new village, you're limited to 2 plots, which is 2 tile squares. You can put 4 houses into a single tile/plot, but the farm takes up the entire plot.
So in your screenshot, the number of buildings is normal for a starting town and if you look at the status info to the right of the the center portrait it shows you have 0 plots available to build on, which is correct.
Edit: It seems if the sovereign owned any units when it was defeated the unit pewter pieces remain on the map but can't be interacted with.
