Strange about the frame dropping stuff. I tried to optimize it by just enabling the gameobjects around the player and that helped a lot. What hardware specs did you use for playing the game?
Okay, I already thought that there is some 'bug' and you have found some which leads to frame drops. 👍🏻 But yeah, integrated graphic card could cause such issues.