It recovers at the start of a new day. But there are also modifiers like Womb of Lust that reduce it!