The fatigue (that's a much better word for it than my "slow"; I'm going to steal that) only affects movement. I think I forgot to add that detail into the instructions! I.e. if they are fatigued, they can't move, but they still participate in any combats happening in their current room.
Thanks for playing!