I would definitely have used standard controls on the menu and left the 'one button' to the game.Clever name and interesting idea, but having the direction reverse every time doesn't feel intuitive.
Thanks for the feedback!
We'll definitely be changing the way the menu is navigated.