It really is annoying, but I didn't know how to solve it, so he would jump normally even if touching the wall. :( ... I changed jump height so now he jumps quite smoothly even when touching walls