That's a good point, I'll add that.
In the mean time, you could save a copy of your layer set with the mouse tracking and one without, that way you can kinda switch between them