What settings are you using? Everything to max?
Viewing post in Terrible drops in fps
Well, there's some experimental settings that are gonna have a larger performance impact than usual. Consider, this game's still in development, it's not like a finished product where all the graphics options are convenient.
Try turning down lighting first, but before that, open up task manager, and see which part reaches 100% usage while playing