Nope, it doesn't need to be a visual novel. it can be any kind of interactive fiction game in any kind of medium. As long as it has text, like reading a novel. A game like Hotel Dusk is a perfect example of what I mean. Conversations, exploring rooms to pick up mysteries, etc. It's considered an Adventure VN. It can be choice based or linear. Just as long as there's text.