Yes you need to be like super close to it. Maybe make the colliders a bit larger.
Oh, I see what you mean. Thanks a lot for the feedback :D
