It will only work if you're not in any menu (including main menu) and not in combat (so only in the overworld).
The button is also tied to the physical location of the ` (right under esc), so if you're using a different keyboard layout it can be a different key. Try pushing some different keys until it works.