Actually you don't have to manage them all. Focusing on one color only, and keeping a restricted number of active notes, is the intended strategy. Ignoring inactive notes or other colors is not penalized. Unfortunately I fear I haven't made that clear enough. The reason that there is so many dots on the screen is mainly so that they can bounce with each other.
Thank you for your feedback!