I think this is a bug with particular versions of Godot 3.4. If I remember correctly Godot 3.4.2 has this bug, but upgrading to Godot 3.4.3 fixed it for me.