Glad you like the game! If you choose to avoid a relationship, you will only be locked out of future H-events with that character, and they won't mention your relationship in normal events.