Don't worry about it, I updated the game to make the heavy punch/special punch cooldown match the little meter. Makes it more intuitive. :)
