Thanks for playing! I'm pretty sure that slow down is caused by the increased physics cost to your CPU as more balls are needed to collect them. If I decide to go further with this game I would probably write my own code for the follow since I just used Unity's built in physics. As it stands physics is over 80% of the CPU usage.