The second group of bandits to the left of the castle gate gets bugged some of the time and locks the game in a state where you can't continue. It's best to avoid that battle.