Sex usually doesn't impact the main story all too much, since I don't want people to feel 'punished' for playing or skipping them. Enjoy to your heart's content!
Oh alr, thank you! I finished the route and enjoyed it! The reason I asked this, is because at the Gym scene on the visitors day, chosing to not have sex felt as the better choice for me.