Yup, I made sure to do it as soon as I got the talisman. I only had 7 stars (to beat Saad) and then after I grabbed the last piece I went to the picnic table.
Ahhh, that explains why I couldn't figure it out. I was trying to do it after I had defeated everyone and already had the orb. Thanks for the tip!
