you don't?
Once you equip it, that's it. That's where it'll remain, if you don't want to equip it, you can just hold it like any other weapon or box and carry it around, setting it down, etc
afaik at least, I didn't actually try and see if it still had physics