Yes, the last floors of the labyrinth are difficult, it took me a couple of tries to remember the location of everything. However, this is not your first or second dungeon...don't expect a tutorial that will explain every little detail to you. Expect some kind of challenge.
If you still have difficulties, just lvl up a few times and beat it with brute force.
Hell...you could copy the maze on a piece of paper (I thought about it) but I didn't need it in the end.