It's almost certainly an optimization bug. I'm aiming to do another performance pass with 1.3.
It could also be a bug in pathing that's already fixed for 1.3. If an entity or warband gets stuck trying to reach somewhere, performance takes a major hit.