The game has multiple routes. If you stick to the romance routes for each character, you should be able to avoid that.
