Interestingly, for me, this is what actually solved problems with tile-based colliders. I guess the difference in outcomes comes from some other details of implementations.