Yeahhh the timing is really too fickle (you have to already be sitting on the right lane at the instant the beat changes, even if visually you were there a fraction of a second early/later).
That would definitely be an improvement I'd make with a bit more time