That happens when the game slows down too much. You could try lowering the graphics quality for now, but I have an update coming that fixes that once the jam is over. :)
You're right, the game is more fun at lower graphics. However, then it doesn't look as good.
