If you're using DS4Windows tick the 'hide ds4 controller' in the settings, that usually fixes the issue.
Hiding the controller didn't do anything. Putting the sensitivity all the way down stopped the spinning but the camera faces the ceiling rather than straight ahead