Alright, this looks terribly wrong. 😆 And I thought it worked pretty much flawlessly on my system.
Edit: It's probably because the way the button is registered is different when I'm using my wheel. And I didn't test it with a controller.
And indeed, I just added one line of code after changing the camera: camViewButtonPressed = false;
It's fixed now.