I noticed that the music faded as I moved away from the start position. I'm guessing you used an AudioStreamPlayer2D node? If you switch to a regular AudioStreamPlayer it should stay consistent no matter where you are.