The whole territory belongs to the villagers and the owners of the castle. Goblins and bandits parasitize on these territories. Remember the lord of the rings.
