Thanks for the great feedback. I took your advice and tried baking occlusion culling - which took over an hour - but the result was much more performant and resulted in greatly increased frame rates. Please let me know if you have any other great advice to increase performance - thanks!
Viewing post in Dungeon of Nekros VR jam comments
If your using Unity turn the stats widget on as you walk around. Check different angles to make sure its not going to too high of verts and batches. If it is think about changing your layout so less verts are on the screen.
Also the aim was very off for the wand. I would think it would aim like a gun but was aiming a lot higher.