Honestly, yeah. The first area has pretty much zero drop, but the moment you finish the tutorial and visit the outside/overworld, the fps begins to dive significantly.
Seeing as the overworld is huge, the low frames are the result of loading a huge chunk of the map all at once.