It's a simple idea that really amps up the challenge of the game but taking away control of the ball. A suggestion, maybe make the players the 'wall' instead by letting their paddles curve onto the top and bottom to form your own walls? Would really amp up the game and open up possibilities.