SPOILER ALERT
Do you have to side with the Lord of Bones to make any progress in the game? All the lore points that being a bad idea but I don't know what else to do.
Not that I'm sure it will help: I tried with a separate save doing so and I easily got killed by the Stargazer.