That's got a lot of potential. I think it's an interesting idea. There could be a game involved here somehow, I'm sure, I'm not sure HOW but I'm sure there could be. Very interesting concept!
Maybe some kind of word puzzle where you ask a question and give a tonal response and its up to the player to find the correct answer with the pitch tonation as a clue!