How many fish traps do you have? Do you have a mining laser up?
I had somewhere around 6 fish traps. Lag was present without the mining laser, but just two later on. When a few items piled up around them there was a noticeable FPS drop, but the item piles were from just one or two rocks.