I'm going to be entirely honest if you were to remove or greatly lower the exposure of the h scenes then you could potentially make this a five-star popular anime the story is just incredible and the characters are so deep.
I entirely agree this was one of my initial thoughts, I have but barely started the game and it stands out quite a bit. It would probably pass as an isekai anime with, an optimised amount of fanservice.