When you hover over the item, you'll see that it has an uncurse goal. Once you fulfil that goal, you can remove it freely.
