It’s almost certainly my fault, so please don’t trouble yourself!
From doing some research it seems that nvidia drivers are more forgiving than AMD with data you send to the gpu, so I am probably sending bad arguments somewhere and nvidia is not reporting them as errors. I will try and get access to an AMD system in the future and fix it then, but for now thanks for letting me know there was an issue, I appreciate it :)