I didn't have a lot of time to make things super clear, so sorry about that. Once you're in a dungeon you have to find a portal (a rotating circle in the middle of one of the rooms) to leave.
The direction you attack in is where you mouse is so if your mouse if always on the right that could be the issue.