I like the idea!
I did get quite frustrated with the controls, maybe the change between states could be a bit more streamlined , hard to explain...