It seems the Godot 4 requires to used an itch.io "experimental" function which is unstable in some browsers. I'm uploading some downloadable packs now.
I just reloaded the page a few times and it suddenly worked, idk what changed. Im using godot 4 for my game too and had the same issue. But it works now!