I'm not sure what parts of the events you're currently on, but maybe you still need to build the bathhouse at the overview map and then visit it. You'll meet a woman in the outdoor area of the bath whose events are necessary to advance the events for both Lady Akira and Grey.
Losing the battle in Thremten has no big consequences, no need to worry about that. ^^