I think you just need to buy a pickaxe from the blacksmith and then go down to the caves under the tavern.
