I could be missing something, but I was unable to leave the village either to return to the forest or to go into the mine. The message was that I needed to see my house first, but I had already slept there twice.
Did a Goblin run up to you just before you first visited the house?
EDIT: There was a bug related to rainy weather that broke that step of the game, I fixed it now so it should work, but you will have to restart the game for it to work though :(