Currently, if you choose not to fight the monster/spider/bandits/etc. the quest location disappears from the map, and you then have no way to complete it. This is a known issue, and hopefully it will be fixed in an upcoming patch.
My recommendation is to always save before moving on to a goodie hut, so that if you end up choosing 'no', you can just revert to your savegame and the quest is still there for later. A pain, I know, but that's the option for now...