To get off ladders, you have to press diagonally up. To reach a corridor directly next to a ladder, you should be positioned roughly a tile lower before jumping.
This is a consequence of having only a single button controller...
With some practice this should not be difficult anymore.