So I was going to do the Milford war thing and got the divine object to get through the barrier but I choose to leave the conversation so I could rest some of my party members, when I did I got locked out and couldn't reinitiate the conversation again and couldn't progress the story anymore.

It's the same for the part when the elf woman gets interrogated, two months after you talk to Aire in her cell :P