What format is it all in? .ogg is typically reasonable on file size without raping the sound.
I think UE4 only supported importing wav files directly and that's why I went the lazy route. I *think* UE4 compresses audio to something less massive while packaging it, but I have to say I never looked into it enough to say for sure.
