DO take the key, but just make sure all the slimes are dead first (or not near you). They get real angry when you get that key.