You can unequip items by opening 'Equipment' tab in top left corner in your inventory and clicking on the icon of an item you want to unequip
Yep, you're right. I think my save was bugged. After starting fresh, all the issues with equipment disappeared
