Correct, only that one has 3 floors right now. I do realize that the dungeon might be a bit too confusing at this build, but I am going to work on improving the visual clues on where to go.
Look for a blue sign with arrow pointing down, get close to it and you should be able to press the door button to go to the next floor.
