Really interesting concept for a game. I agree with some of the other comments that (in an ideal non-game jam world) there could be some ramp up that allows the player to get comfortable with the controls and the concept before jumping right in - but I totally understand that things like that can be impossible to think about during a jam.
All in all, really well done!