My lumberjacks are stuck by their own buildings. They should be able to either pass through them or go around