I did some experiments and it’s the Godot physics engine causing the frame drops. Likely in combination with my level design and how I generated the collision meshes. 4.4 has jolt included so I should be able to update after the jam.
Cool to see you found the issue!