the problem with that is you can only pick one person that they have relation with for each charater, i can only choose weather the the brother has relations with the sister or the mc, not both
No, after switching character relation last selected state is maintained, when you select one relation and then switch whatever was relation before character switch is kept.
Pic shows an example of setup you mentioned. (igonre wrong surname xD)
