I have just uploaded a new version with the issue fixed.
Using raycasting as you suggested was a great solution, thanks!
That works a lot better! I got "Oh come on!" trigger several times though. The first time I played it I only noticed it once, when I fell. This time it triggered a few times as I made my back to the ladder thing. Could that be a result of the raycast? Maybe it was always there though and I just got lucky the first time.
Regardless, nicely done! :)