Select the character you want to leave the party and pick the Ask option, you should have an option to part ways.
There might be a chance if a character joined your party during their story (like Ebiko) that you won't be able to take them out of your party until you complete the quest that requires them in your party.