It's the double-click factor. You might want to mention that you have to double-click icons, in the game description.
I had a similar issue, until I started spam clicking, and figured it out.
Okay. I will add something like a tutorial notification when you start the game for the first time
I'm surprised you replied so fast, but that's good to hear!
