Just a thought, random encounters due to influence. Say after influence reaches 1000 there becomes a 1% chance per every 100 influence points you can be targeted by bandits, thugs, etc... and do have option of running away. Fighting would be the same rewards as whatever the normal for defeating them on the map, but running away hurts your influence for say, 50 points due to people thinking of your MC as a cowardly type, and would also be a good reason to keep slaves, hirelings, or both with you at all times.
That is something I'll probably look into later. At least for lawless districts or areas that are not deemed completely safe (like Hamilton Square, Whitehaven and future Crystal Hills).
A retreat option will also be built into the combat revamp when I start working on that after the slave update (0.8).