When reviewing the Godot Engine's documented audio issues, I did come across one talking about issues caused by an audio player being active for an hour+, but hopefully the lag occurring after a while is something I'm not cleaning up in my code.
Hopefully I can diagnose why the Windows version has those issues, but great to hear that the Linux one has no glaring issues. Thank you for the comment.