They're on the challenge floor. You can enter that floor until you've finished the other floors and saw the note on the Aldlyn city board inviting you to the new challenge floor.
