Found it. I have what was supposed to be a very small chance to automatically increase or decrease fetishes each day (if you did lots of incest actions in one day they may “sleep on it” and gain fetish in it, for instance).
The chance wasn’t apparently small enough. Lowered drastically.
