I know that there more than 4 colors in the game. I tried to fix it, like disabling smoothing and using bitmap only fonts. But despite all of this, the issue still persisted and the deadline was approaching. So I had to leave it there, and I am considering to make a post-jam version of the game using another engine. Anyways, thanks for the feedback.