Use a two-finger tap, tap once with two fingers. It's a common feature for Android devices to go back or cancel something. This will both delete a symbol during the naming phase and allow you to exit a menu. If you use it while no menu is present, it will call the standard on-map menu.
I'll make a FAQ post later today.