I like the idea of creating the tower that you will have to climb later. Unfortunately, I had trouble getting used to the climbing controls.
I agree the controls are both tricky and also awkward, but were the best that I could come up with to serve for the idea. Thanks for checking it out!