If items are removed by pressing 'X', they disappear completely after collecting them. I created an oven, removed it accidentally from the inventory and collected the little box, but the oven was missing and the 15 stones from the crafting process too.