Oh yeah, I forgot to mention; for Godot 4, you should try the Godot Jolt physics addon. That might help your problem by itself.
