Same thing happened to me :(
I beat the math game and didn't think anything of it and when I exited I saw the drawer and it dawned on me what you're supposed to do. I went back into the math game, used the notes to get the symbols and left.
When the music kept playing I was worried, especially when I went back to the computer and it was off :/
Oh well, guess I'll start from the beginning.