The idea is really cool. My main problem is with the lack of rhythm feedback and transitions between musical pieces. Like when you attack, cutting to an other track without fade or transition feels weird (and it creates a click)
Beside that it's fun, with more polish it can be great even :)