You're not doing anything wrong.You just can't change weapons unless you're in IDLE state, so you're out of luck for this one.
That's okay, I'm doing a workaround by having the crossbow be a low firing rate weapon with unlimited ammo, therefore no need to have the "emtpy bow" sprite/state. Thanks anyways!