Did you try to go down, pass, the sign that says "Do Not Enter"? The red-haired dude is not supposed to let you pass.
The red-haired dude stay on same place after his dialog. When I went down nothing happened.
I added this to the information section of the game page: ***On the second map, when reaching the bottom, please click [ENTER]. I had forgot to make the transfer event touch, instead of action of action button.***
Thanks for letting me know. :)