they fly back because while the black hole wants your help, it is also incredibly greedy, and cant stop trying to eat you.
