I got it to happen, I was wearing violet as panties. It might be that, or having talismans on the shrine mightve messed with it.
