Thanks for the feedback!
It REALLY needs an in-game tutorial 😅 When you stay still, you convert metal into "culture" ( a hidden resource), which defined how many people will join each time you arrive at a new city. Also, if you are caught by bandits and don't have enough metal for them, they will take even more food as they originally would, and will kill some of your people.