Does the 4 colors only rule apply to the game cover, screenshots, ... as well? Or is it just the game that has to be 4 colors? 

Since the entire game should be four colors, that should result in the screenshots automatically meeting the requirement. You’re free to do whatever you like with cover art and the game page in general.