I suppose the majority of commenters have wanted simpler controls, so that's the zzzzzensible conclusion. You're very right that the puzzles should be the focus. We've toyed with the idea of using arrows on the ground that you choose from, or fixing the controls (but that might be similarly confusing, as you can move the camera). We'll keep at the drawing board!
This is our first ever "finished" game, so we're very tempted to make a full game out of it. Thank you for the very kind comments, it means a lot. :D