Interesting twist, though I think that hitboxes should be a bit more forgiving.
Yes, I made the box colliders too big.