There is one hint that is given in the banishment cutscene. I don't remember exactly, but it had something to do with not being a creature of the living or something like that
Yup, I made sure to do it as soon as I got the talisman. I only had 7 stars (to beat Saad) and then after I grabbed the last piece I went to the picnic table.