You need to have sawmill unlocked (Finished event in the forest, showed the girl's pendant to the bartender). Illness event also have to be finished. Then at day 20 there will be attack on bareshade event. After talk with the lumberjack you will learn about the location of bandit camp.