Ellen comes up to you at some point and tells you the Dungeon is available to build. It's mostly just a recommendation and has nothing to do with a character's story level, but the game does let ya know ;)