A bit confusing with all the controlls but I feel that was part of the idea. Really liked the idea of multiple simple task being done in parallel. Seeing times on the leaderboard shocked me how bad I was :D
One thing though. If you feel we might press restart by accident why don't you move it to esc menu?