It seems if you make a design with more depth, even with a base mechanic (here one button), it can easily be overlooked by players :/
It's hard to keep conveying an easy idea with a deeper design... But that's also what's interesting :)