I've dismantled the pyramid / open cloak looking statue nearly every time I've seen it and have never gotten a curse though.
