F when you are standing in front of it. The button on the HUD should light up and a selector become visible when you can interact with something like the crystal, items on the ground, or doors.
If you are still having problems can I ask that you take a screenshot of you standing in front and facing the crystal or items? I have never seen this problem before.