It's finicky. You may need to click on one of the buttons in the game using your mouse, then go back to gamepad