If you collected the key after talking to Mr.Retro you're suppose to go back to where you saw the hole on the ground and go north. There's a locked block there for you to use the key. Always explore all areas 😉 ill put that in my notes to make some areas more noticeable.