That is probably because I manually placed each platform into the level and each one has a collider attached to it. Also, the texture for the basketball and snow was manually made and is likely extremely inefficient and causing problems. I probably should have made it so the platforms were destroyed once you left the collider.
The sphere does scale up it is just very minuscule. By rock texture do you mean the white texture. That was meant to be snow haha, I guess my texture creating skill needs improvement in both realism and efficiency.