I created a town next to a lost library and after building a few other buildings wanted to build on the resource.  The icon is there but after clicking on it the area does not become green.  I can click on the map and the build icon (the circle of the building with the timer) will be displayed but nothing happens.  After checking back later the icon was gone (before the 10 turns it was supposed to take).  You can also click on the map multiple times and have the icon show up more than once.