After you do the camp infiltration you'll be able to spare with the bandits and you get to choose which ones you want to spare with.