Only at night, you can go to the camp and the option sneak inside will appear, sometimes it will lead to an encounter with bandits, you can just escape and try again til you find the plot point
