The forest path is only available after you finish Bandit's camp side story, and talk to Jester at your home.
