It's definitely the black spot on an otherwise fun game so far. I still haven't beaten it yet. I'm playing on Mean, but even when the Slow Down mechanic glitches and the slow down gauge doesn't deplete (allowing me to be in slow down forever), I still lose.
Also, don't use a controller here. It will mess with the keyboard controls, and it will render the WASD keys unusable.