This is a really interesting concept. I think that it would benefit from smaller, more interesting patterns to match than the whole row or a match-3 type thing to speed it up a bit, and encourage the player to keep pace with the music.
Thanks for the feedback! Glad you like the idea!