Cool mechanic, really well presented. Had a lot of fun making my way through the puzzles.
If you come back to it, I think extending the control scheme so that you can switch using the keyboard too would make it a little less finicky.
That would be a great option. Thanks for the feedback!