I think in situations like these you have to click the finish reorganizing button before you can put it back.
