Hm, for some reason turning left was not possible for me. It took me a while to get my mouse trapped, so that the key presses got recognised.
But once I managed to snuck after the follower, I was safe :-D
How was I suppose to know which way my home was? I only see a green area (the starting point?) that differed from the rest. Sorry, I lost my map :-(