After you get S'Rami on the team, you just leave the underdark right? I opened all the chests, couldn't fit in the goblin hole, and killed every slime I came across, the goblins, and minitaur.
... If so, I can't seem to get that transfer event to occur at the bottom of the port town. Do you go to that bottom walkway, the guard to the right bottom or...?