Yeah that was my own issue while testing too.
I simply just couldn't find a clever solution, and i ran out of time