I think the main idea of that rule was to give a really old school game feel. Looking at "CGA colors examples" from google it seems it is meant to be just 4 colors at any one time with possible palette switching between scenes (maybe).
Thats what I was thinking too but wasn't 100% sure. Thanks!