First of all, if you have taken the time to try out the game, thank you!
If you happen to notice a bug that needs squashing, post it here and I'll do my best to get on it.
After some investigation, there was definitely a bug with keyboard input!
Sorry about that -- it took some tinkering for me to replicate the problem. I've uploaded a new version which should be fully playable on keyboard now (though gamepad is strongly recommended if you have access to one)
Thanks for pointing this out!