To get to the docks you gotta enter the fireplace. He opened the path for you if you've already spoke to him after getting the trader's reward.
