I tried to make it play out so that the replaced players are the ones who use their alternate spots first. So after they are replaced they move away from the table to make room for the new players, and now that is where they are hanging out.
It doesn't always quite play out that way if multiple people get replaced out of the same spot in a weird order. I think I might be able to tweak the replacement selection logic so that players replace other players in the exact same spot more often, which would lead to fewer of these situations.