I was afraid they would be at first, but it turns out Unity's collision system has a relative velocity check cooked into it! Tuning it was the harder part.