what I usually do is set the volume on all your sound effect's audio sources to 0.4 o 0.6 while the background music/ambience stays on 1 :)
Thanks! :)