Thank you! That video helped to fix it permanentely :) I also managed to fix most of the bugs you mentioned and improved the map a bit.
I tried to profile the fps drains..seems like the most drain comes from nanite raster sizes. Couldn´t find a way to load seperate foliage actors instead of the whole instances (using world partition). Will have a deeper dive into that :)