Thanks for the feedback @indutny! My thinking was that having your new friends annoy a little would be an incentive to try and bring them back to your ship as soon as possible. So, at any given point you have to decide to deal with them blocking your progress or spend the time to bring them to your ship and come back.
Thanks again for your comment and for playing the game!