I don't believe they despawn. You'd have to interact with them in order to get them to go away. If they're still spawning, though, it may be because you still haven't eaten enough. What is your hunger percentage when you're seeing this?
