I kept trying and eventually it worked, I'm not really sure why though.
Maybe the clickable range is too narrow. Anyway, I will try to revise it. Thanks a lot for your feedback!
And thank you for making an awesome game! It is very very fun. Great idea overall.