Thanks for the feedback!
I added a something fairly last minute to deter from using the capture duck spell on the goblins that would speed them up if you used right click instead of left. As this was not clearly signposted, in hindsight I think this was a mistake. That might have been the cause.