District labels can be hidden by setting Style > Elements > Districts to Hidden (can also be done by pressing L a few times).