This is a bug with Godot that may or may not ever be fixed. A friend of mine was experiencing this before and found a solution that worked for them so maybe it'll work for you as well? Mic Delay Issue - PNGTuber Plus community - itch.io
I did try that but it didn't work.
