You have to do what you have to do. I know it sucks to have to back track but if this is what you feel you need to do then it just means a better continuation of the story for everyone :)
