I did, that's the issue, although... they were greyed out and didn't exactly show they were in my party, maybe they were still considered in? I don't know...
But the fact that Biyo was able to join and me going with hackmon and it worked makes it more confusing...