So, it seems I found a softlock. Dunno why, but I assume it has something to do with the shibaru rope while with the Whisperers. I was also with Rinny, in case that affects anything.
Edit: it happens when they possess you and try to make you take off your clothes.