So I was going to do the Milford war thing and got the divine object to get through the barrier but I choose to leave the conversation so I could rest some of my party members, when I did I got locked out and couldn't reinitiate the conversation again and couldn't progress the story anymore.