I do like your idea of making left click stab the brush but maybe temporarily disabling it for a bit.
