I kept breaking the gem... any advise how it works...  I am hitting it on the right color.... is there a mechanic I am missing...