Yeah, I agree there should be a storyline where the noble lady is able to convince the guards to let you escort her into the Doom Fortress. Its a story flaw I think.
You may mention it in LonaRPG discord server.
https://discord.gg/Vet5WGxzJY
