They can't still be a guard if you want them back in the party. If you've dismissed them from being a guard, on the overview page, there should be a "edit party" button at the bottom.
