That's because you can only click it when it is. They are toggle tiles and need to be clicked in time.
I would recommend making it so that instead of flashing in and out of existence, it flashes between a regular number and a red number, so it's more clear that clicking it = bad ;w;
Yes, there is lots of room for improvements... uwu