Well, probably you can swing the red ball and not lose if you have the skill, but I don't have it. Perhaps it requires some time to get used to.
But yeah, I think it should be easier, at least in the beginning - having a slowly increasing difficulty would be nice IMO and give some time to adapt without too much frustration.