I don't know if this is a bug or not but one time I used the transcendance ritual and I kept the ritualists for the other rituals and if I remove them I get negative ritualists so I keep them there. If this is a bug then please don't fix it. It is really helpful.