I'm glad you liked it! You can go back into the gem cave area and get a gemstone that the merchant will take. She'll give you a key that will unlock the towers.
