This is simply to make combat more survivable. If the enemy dealt damage at the same rate you did, you wouldn't survive your first encounter most likely
I agree with that rule. In solo with OSE, I often didn't roll the damage and went with the average. It speeds up play a little but your method add surprises (low score)!