Oh i went right first thought I had to do the puzzle and get it first mainly for the 2 chests in it
No. About 95% of the puzzles are completely optional, and the ones that you need to solve for the plot are easier to beat. So, if you are stuck with a puzzle - you can safely ignore it most of the time.