Of course you are.
The problem with the looping map is, that it didn't seem to place me where I was before, hence the backtracking to get to a different Area.
I'll give it another go later, trying to talk to all the blue Guys then, I just kind of assumed they were generic NPCs like the Rest seemed to be.