Oh Godot physics...whyyy?? :D should have probably increased the physics fps or detected the collected orbs through my own logic. Thanks for letting me know!
One recommendation: I don't know how are you implementing this but I wouldn't rely on the engine's physics for this game. That would solve a lot of issues!
