I played before the explanation, so I was a little confuzed. But interesting idea!
My suggestion would be maybe add some challenge (or illusion of challenge) to getting the flowers. Maybe add a timer that doesn't actually do anything, just to toy with the player even more.
Good job! :)