A pop up or prompt explaining what the symbols mean and exactly how many of the criteria you have to achieve would be helpful. Aside from not being very intuitive it's a good looking game with an interesting mechanic.
*Edit* Example. It wants Smiling and topless in green and sports and travel in red. Click reject on the one that looks angry and fully clothed and it says I am wrong. There is nothing very clear in the game on how you have to actually play to get it right and seems like blind luck.