You can! Pressing the "x" key will close any menu. Check the hotkeys section in the Settings menu to see which hotkeys are available to you!
