ok, that is really weird, but I gave the new input system of unity a try, which solved my problem with reading the gamepad correctly, but now mouse and keyboard is having problems...
Yeah, I had little to no game juice for my last game jam games and I wanted to put more in this game because it is the perfect type for that :D
I was tweaking the controls a lot. One tester told me it's to direct, then too sloppy/slippery. And balancing the damage, player speed and enemy speed, health and everything was very tricky. We might went a little to easy, but this way more people should enjoy the game. Old casual/pro gamer problem.