I've noticed that sometimes the image pass through only appears in one eye. Probably the best thing to do is to disable the image pass through by tapping the left orb at the start if it's not working correctly for you.