That happens when the party splits and they get later added back into your group. A while ago, I added a system which adds them back into the previous formation, but in some cases it still works by adding them back in order of the database and therefore breaks your formation.