Yes, that's right. There is a goblin standing on a square with a "magic rock".
When you defeat the goblin, a window will appear prompting you to collect these stones.
You need to put the stone in your inventory at the bottom of the window.
After that, you need to leave the location through the portal.