For me this issue turned out to be because I was setting the depth of my instances after they had loaded it was putting them into a new temporary layer.