if you get closer to the sword, you should see a hint that you can pick it up with the E or F button.
theres also a button to drop the current weapon: Q - if you would ever want to go back to using your fists ;)