I think you need to set a deadzone for velocity/momentum to prevent the ball from going into perpetual oscillation. (I think it's this oscillation that's causing the problem)
