What are the barkeeper hints?
At one point, you will meet an elf in the forest who will arrange for you to enter the city.
After talking to Bert to arrange the meeting, you will need to go to the lighthouse for an event.
After that event, just keep talking to the elf guard in the Elf Town.