You can rotate the scroll wheel, which rotates the arrow to any angle.
I'm not 100% happy with the current implementation, since instantly getting them to be vertical was pretty nice. Will probably revisit it in a future update.
since the game doesn't have any use of the crouch button (albeit it could be useful to dodge sword swipes and arrows), you could set control as kick instead
