Sounds frustrating indeed. I'll keep working to optimize it! We have a parallel Unity project for code rewrites that I'll be migrating to, now that Act 2 is published. Fingers crossed Act 3 will be less buggy! :}}
(Also I gotcha fam, I added a cheat code to skip the plant quest minigame that'll be included in the upcoming bugfix patch!)