Think you might need to use a different audio system or in fact 2 audio sources and just crossfade, which i think would be the easiest way of doing it.
Yeah, this is the 2 game object we talked about but I'm hoping for a better system :)