Ah, I had the same issue. The solution i found was to go to the hidden folder in your project `.godot/imported`. There you can sort all imports by size and see which ones are unnecessarily large. In my case, the largest file was the ambient sound something like 130mb, and just compressing that file solved the issue. Maybe something similar is happening on your end.
Glad to help, we're all here to learn and improve.