Go to the Labyrinth and pick the option similar to "Leave labyrinth" (sorry, don't remember the exact wording right now).
