I captured an AI city which contained an adventurer's guild (I hadn't built mine yet). I didn't want it in this backwater city so I destroyed it only to discover that I couldn't rebuild it in any city. That strikes me as being a likely bug.
Why would you want to build one in the first place?
Good bug report though.
Your godly sov is off soloing the world. adventurring guilds let your useless champions level up so they can gain spell casting so you can harvest their souls to boost your sov