Increase the delay between a boss being defeated and the next one showing up. Or, perhaps, have an (early-game-unlockable) toggle for aggressive/normal/defensive that makes all ships show up immediately/after one turn/after two turns.
Thanks for the suggestion! We will take a look and see how that feels.