I imagine it's a technical in engine problem that's much easier said than fixed but I really can't understate how much better the game would feel if the rescaling just stopped you from expanding in ways that would clip you through the wall instead of resetting your size. It takes you out of the game a lot in a game that's otherwise almost perfect.