OOOhhh this is a really nice puzzle idea! Unfortunately i was not smart enough to finish the game lol.
Haha thanks! There's a walkthrough in the description if you want to see the answer :)