And indeed, I just added one line of code after changing the camera: camViewButtonPressed = false;
It's fixed now.
