Thank you for playing!
I think it comes from a conflict between the mouse and the keyboard control schemes that are active at the same time. I would definitely improve that if I would continue working on this!