It's a really cool idea (and throwback to ice climbers I suppose hehe) and it's fun to play; however I did find myself basically giving up hope if the roll was too low (floors of 1 felt way too punishing). Thinking of ways to balance this while keeping some random unpredictability, maybe the rolls happen on a per-tile basis? maybe you can re-roll floors or tiles on the go?
Just some random thoughts, I liked the game and think with some polish it can be really cool! Good job!