They might be used to get you places you couldn't go before, but probably not anything game breaking. Fast travel no, as the game expects you to leave/enter through specific areas in order to set required variables
