I would say it is kind of a death spiral. The hit points reflect more of the superficial physical damage and exhaustion. Once you start taking damage to your grit, these are more serious wounds. And yes, that means that when rolling grit, you are rolling against whatever the current value is, even if that has been lowered by wounds.