I'm currently encountering the same issue, I subdued the mage due to my high magic, but when I returned to the brothel, I couldn't proceed even though I had read the diary already. Owen back to the manor but it says there's nothing left at the manor so I can't go in. How did you solve this issue?