Hi Sam, sorry to hear you're having issues.
Can you check your controller set up since you're running it through DS4Windows?
The game uses Unity's new input system for both keyboard and gamepads so the code that runs when either are used is identical.
Are there any differences in your issue when you use an xbox controller as opposed to the PS4 controller?
The other thing you can try is rebinding the keys for the gamepad in the options menu, if you go to rebind a key it'll wait for any input before rebinding it so if you still have trouble there it might be a controller issue.
Would you mind posting a video of the video?