I finally found a solution, but it's too complicated to explain it here, haha. I set it up so that you can easily swap out the sprites, 'cause I plan to add a character creation to my game. But if it works for you, congrats! :)
It's nearly impossible to show it to you and would require a true wall of text to explain it, but if you want you can send me a message on Discord (Vexoriette#2473) and I can explain it there for you :)
But beware, I'm working with Unity so if you use another software I'm not sure if I can help you out with that.