Yeah, the time thing is a big problem. I reverted it back to the standard minigame, for now. I'm trying to find a good minigame concept to fit the fast pace of the game, but I think mashing buttons is the easiest solution for me.
I had an idea where thought balloons would appear over the player's head and you'd have to select only those featuring pure thoughts quickly to escape. I might go with that.