I encountered that too, but I found a solution! You just need to always stand in the middle of the circle that leads you to the other area. It always worked for me!
