Thank you for the comments!
After the gamejam, I'll upload a new version improving the controls, more or less like you said ;)