You also need to head home after that to have Jester trigger a conversation with you before you can head to the forest path and visit the areas past it when exploring the ones you unlocked if you take the sub path with the bandits in that camp.
