The key you got unlocks the well. You need to go down the well, and just follow the path to the end. You should be able to get into a new area called the Bandit's Hideout. No need to go back to the slime caves!
