Very, very cool idea. It's heartbreaking that it's so buggy, because I would love to see this concept in a more playable state.
I will say, you got an adjustable jump height in your controls, and that's something I struggle to do (and even omitted from my game because I couldn't get it working), so I give you props for that.
Great job overall, though. I would be interested to see where you take this after you clean it up.