Hey Ice-creamsandwich, to use it, you hold the 'alternate' button (you can check what you have it mapped too in the menu, by default it's mapped to left shift for the keyboard, and the left triggers or shoulder buttons for the controllers), and press one of the attack buttons.
The special attack is typically used to parry, though not all weapons can parry and some just have alternate attacks for it.