Oh that makes complete sense! Just somehow missed it :)
Oh I don't think the ladder was a problem so to speak, it was more about once you started climbing you couldn't do anything before you were up the stairs, so it kind of forced the climb up, what I would have thought/liked was more of a free up/down movement on the ladders and jumping off when you want.