Yeah, actually I am remaking the game with Godot and seems a lot better. I did what you said too. I'll post the update.
