In the example mod, there's "ignore.json" file:
{
"Ignore_Idol_Portraits": true,
"Ignore_Files": []
}
You can add it to your mod to remove all default portraits from the game. (But keep in mind that your old save files probably won't work when this mod is enabled because of idols in your group that use default portraits)