This was clever and fun and I think has a lot of potential. If you decide to go further with this, really take to heart the idea of a "catch" in the puzzle. Where the obvious and easy solution would be to do "X" but "Y" prevents you from doing so. Having an "undo" button would also be really helpful.
A little bit of audio and maybe arrow icons for each of the movements would also go a long way in terms of instant readability.