My gut feel was something like an FPS where your mouse is locked to the middle but it records your movements, which it then adds to the ball's velocity. Likely with a lot of inertia too, so the player can just flick their mouse to fling it at a certain wall.
Of course I have no idea how this actually feels in practise so it might feel awful when implemented.