Well if you looked down, you may or may not hit one of the enemy legs the enemy's blade would definitely hit your head.
If you look straight ahead they could still parry you even if you're not swinging.