you can talk to jester and repeatedly donate money to the bandits. i find that's the fastest way to increase their morale.
