This game becomes a bit of a puzzle!
Have you considered making the time-bar the color of the next color the player will be instead of the current? This could lead to the player making some interesting decisions to put themselves in a better position for the color change.