For some reason the gems get stuck if you try to use one that hasn’t been used to full charging on a change that’s already been maxed out. For example, with the waist you can only go up to five changes on that pillar, but if you try to go beyond that the crystal you used just becomes stuck there and uninteractable.