Indeed, I programmed the camera. But, I am not sure, it will do any better if I were to use LateUpdate. I made the camera as an individual dynamic object (flying physical body) with seeking behavior, instead of fixing its position behind the players, that's why it follows up the players and doesn't stick to them(even in TPP).
And I really need to work on free view camera motion.