Thanks for the feedback. I didn't have time to make the water actually move, which would have made the physics feel more intuitive. The guy is paddling upstream, when he stops moving forward to turn, he gets pushed back.
