There's a random chance, which is affected by the fear of the NPCs, as well as the physical attributes of your character. In fact, the number of fights and winning it does not really affect this case, so the answer here is the same - it all depends on your luck.