You can only hold one weapon at a time, so when you buy/find a weapon it will equip it automatically, and your old weapon will be dropped on the floor.
