there is a couple of steps needed to get it to work, mainly checking a box on project export and changing the audio to use samples I think.
More info in the blog post: https://godotengine.org/article/progress-report-web-export-in-4-3/#single-threaded-web-export