So, I tried refreshing and continuing from where I was, but unfortunately, it was locked in the bugged state, so I tried starting a new game. This seems to happen when you sleep with the captain of the guard as well (haven't gotten back to the lamia yet). Another thing I've noticed is that having sex with Maggie ends up putting you back at the temple.