If you define (in the beginning) just your work uniform and change with the hot buttons into another set, the clothes are removed in the bottom menu but the avatar stays on work outfit...
And you can leave the bedroom! It just reminds you that you can't work like that!
Too sad male workout clothes aren't there anymore...