I've played quite a few of these games now and they way to remove the grind is to either make it quicker to spend time with girls orrrrr actually make content to fill the gaps that's actually bringing life to the world.
"You spend time with a girl" is the only text we get so that makes it a grind. The whole sending them out to work things is okay but it's just stopping the player from interacting or furthering the story and THAT is the problem because the only reason things are there is to lower the amount of content needed.
I never felt like any of the conversations with the girls were real and as such needed more just randomly talking about something they like or do or want THAT ISNT THE MC'S COCK.