Awesome idea with color combinations, although i think not many people can figure out the correct combinations on the fly.
My friend suggested a tip mechanic that tells player the possible color combinations and i think that would help a lot.
Here is an example:
But anyway, the concept is interesting, props for that!