Yeah, I think you've got a good point, it could have been the gem physics. Had you tried using a circle collider instead of sticking with the gem shape? It might have made it a bit more predictable, which could also help. Just a thought.
Thanks for the advise, but I am using circle collision (it seems that a circle it's just a polygon with a lot of faces, not a perfect circle).
