Cool idea, really buggy. I think it would also be better if you restricted the ball to a 2D plane, as you can't really control it in 3 dimensions. It definitely has potential with a lot more work.
Thank you for the feedback. I agree there are some bugs that will need to be ironed out in the future.