I think you have to unlock the secret door and talk to Golum. Go to the tavern first to get the clue from the minions
