My mouse has a few different sensitivity modes, I normally use the third option out of the four available. So I just switched to a less sensitive option and it was fine.
