I certainly agree with your point about different thought processes- left and right-brained people, maybe. It used to be so difficult to find a game outside specific genres (e.g. text adventures/ point n clicks) where the writing wasn't terrible. I'm in a two-man team, and take on the creative work, while my friend does the technical stuff, which has worked well for us so far. As you say, unless you're a Leonardo da Vinci style genius, it's difficult to be both.
Yeah, there are differences between linear novels, CYOAs, graphic novels etc. and sometimes you'll be in the mood for one more than the other. I think the main issue for me is intelligent and cultured people who don't think they're "getting as much" from a video game as a book- even if the writing's equally good, which is a view I've heard often. I think it's similar to how I used to procrastinate by playing Fortnite but now I play chess. People see chess as more sophisticated and worthwhile but it just requires a different skillset.
I wonder how much people value "worth" by the sorts of people they see as playing video games compared to the people who read novels- and they're put off by thinking they're the domain of a bunch of sweary 12 year olds.
I re-read books all the time! It probably helps that I have such a terrible memory that I forget much of what happened after a few years.