How I access the chest under the temple?

I'm guessing you already figured it out but you had to click on a different colored column.