So, seemingly, the issue was in a way how Opera handles the audio files downloading - it refuses to load them if you aren't going to use them immediately. I did a hotfix for Opera specifically, and it should be okay now, but you might experience little delays when certain audio is played for the first time (cause I can't preload it).
Please let me know if it worked, or there are still issues.