Unfortunately not at this time. I’ve been working on a rework for the entire talk system (which is why it’s been radio silence for a bit) but that isn’t done as of yet.
You can, however, set it up so unique characters automatically consent to joining your party. But not a full system disable.