This is a cool concept.
I could see it working really well expanded into a puzzle platformer with authored levels, and maybe the future gems displaying as numbered outlines or something.