Yes, juggling with Spirit drain is one of the game mechanic that player will have to overcome, until they are able to unlock new upgrade/mechanic to bypass this hurdle.
If you are referring to soul wells, upgrades will help to increase the draw faster. You will be able to finish 10 draws under 1 second later.
With the speed upgrades later, all daggers will eventually be the same 0.5s speed.