Have you finished the 'More Houses' part of Bareshade Expansion? Once you unlocked that and got the morale at least 25 or higher at Bandit's Camp, you need to sleep (8hrs) at your new home during the evening.
There is a chance for Barrel to show up, let him in. All you need to do now is to visit Harold.