That's definitely a Unity thing. You need to change the "Default Contact Offset" setting in Edit > Project Settings > Physics. You may also benefit by changing the Default Max Deprenetration Velocity setting as well.
