Not entirely intended but not as much of a priority as other bugs atm >.<
Just to make sure it is clear how that bug possibly happens, for some reason (I suspect because I use the stranger perk) the Dryad/Catgirl and Dragonheart/Primordial quest groups are not immediately hostile to the player. When they become hostile and start building wooden (Or other) barriers, They are not hostile to the player either for some reason. Which leads to the interactions where you can talk to an inanimate piece of wood.