Thanks for the feedback.
I did reduce the size of the box collider a little bit compared to an earlier update because I had the same issue. I probably should have reduced it a bit further. Changing to a circle would require me to complete rewrite my movement scripts since I am using raycasts for collision detection, so that's not really an option.