Not at all. To describe my work as niche would be doing it a kindness, so I genuinely can't see why a non-gamer would have any interest in it.
With niche games in particular, I tend to think if you find your game worth seeing through to release, then other people will want to play it too- and it's just a case of finding them. That's what I keep telling myself anyway...