You're supposed to rotate them so that the two on the left are facing right and the two on the right are facing left, like the unmoving statues next to them. If you've already messed with them then you'll want to use the reset button, but it looks like that's a little wonky.
For the bottom two statues, you'll need to hit reset, then turn them once or twice, so that they're not facing their starting direction nor their intended direction, then hit reset again.
For the top two statues, turning them four times after hitting the button will finish resetting them if they need it.