I did go back, but I couldn't complete the mission as there was no one in the main hall.
My bad, I thought there were 4 because the quest said only 4 statues, reading the other comments I realise there are 5. I thought there was a bug because when I destroyed the statue that was in the tree, the statue reappeared later, without giving me the option to destroy it. Sorry for the inconvenience!