This is the best idea of all the games I've tried. It's really hard but really cool. However, it would be nice to greatly communicate to player what color and side they are controlling. Maybe changing the whole background color to make the player easily recognize it, and maybe shading the unused portion of the screen that is not being used.
I could see myself getting lost in the game for a few hours if it was a bit more polished.