You have to go to the tavern on the right side of town, you can add characters to your party from there.