Thanks for the feedback!
What you described is basically my original idea for the game! After making a basic "count to twenty" game, I felt that the effects I made were a little wasted and wanted to do more. Then, after adding the minigames, it became impossible to count consistently while playing and the win condition felt random. I ended up just switching the win condition to "win under 20 seconds". The timer at the start is still there though, which I admit is a little confusing.
After watching a few other people play, it seems more fun to go for a low time than a "closest to 20" time, so I'm pretty happy with the choice. If I wasn't rushing the game out, I'd probably replace the timer section with a 5th minigame.