Can you tell me what platform you were playing on? Are you sure you clicked on them in time? You only have 2 seconds to click.
In any case, you can now disable the mini-game option in the settings, and that part will be skipped automatically for the best result. :)