Hahahah fun game love the music and concept! You're right though. This is insanely hard! I think either not rotating 90 degrees on movement or not punishing a player for not moving on beats would make it a lot easier.
