I head the same collision issue in my first ever game jam. The only problem with the solution is, that the collider then uses a Rigidbody, which needs to be static, which could be bad for performance (but i am not really sure if it bad for the performance since it never caused trouble in my games)