Let's assign a pysics body and set friction to 0, also when dropping from a high place the camera stops then snaps to the character a bit later. Can be solved with checks in the update or some sort of value clamping. I have bought some advanced character controllers this sprint sale; I believe there are free ones too that cover friction and camera by default. Maybe that helps.