You must only push the struggle buttons when the bar is green. If it's pink, don't touch. There is a short grace period after the green turns to pink, but not very long.