It seems to be a random thing. I got it to work in my latest run, and from there it worked permanently, but all my other runs had this exact issue.