I think there might be a slight risk when being judged if you elect to do this, but I would personally not take points off, as long as it's clear there are only two colors being used at any given time.
I was only thinking for variety to be fair (think Head Over Heels on the Spectrum). It wouldn't have been a critical element. Thanks for the replies.
