Super original concept! I loved the transition to the technicolor madness of the second part, I wasn't expecting any of it. :D
While I like the idea behind the controls, I didn't get that I needed to hold the click to move properly. I was about to complain about the unresponsiveness when I read the other comment and I get it now. Maybe something that conveys that concept physically like a joystick would help.