This is mostly an interface thing. Often, when I'm trying to spam some houses, it'll automatically revert to inns, so often I'll have 1 house and 3 inns if I don't pay attention. Also, it'd be nice to be able to upgrade houses to their higher-tier equivalents more easily. In general, the interface for building cities is awkward.