I replayed it, and I just noticed the text on the puzzle screen that tells you what to do. I'm sorry, I don't know why I didn't see that the first time.
NO! I added that after you mentioned you're confusion, so your feedback actually helped improve the game!