Well, I noticed, that in part 2, when you get help from Rosalind you restore access to Rugalds mansion, and fight can be triggered again (I fought them before).
hmm weird, I’ll check that the ladder won’t work in next update. Thanks for report!)
