Nice concept of using both your hands. But I can use one player to meet the other. Maybe you should accept input from both the hands and only then the players can move.
You could totally do that, but you'll get a longer time. The concept is based on being the fastest possible :)