Yeah good point. I assumed most people that want the menu narration also use keyboard or controller, so that's what I tested with. But that is definitely a good idea for an extra setting: "disable mouse during narration" or something like that.
