I actually like this idea a lot; with a bit more polish (e.g. making it a more musical/rhythmical thing) and tightening the controls and timings, it could be a really cool and fun game.
