you have to look at everything including the hill near the area where the fence is if you go left, I'm pretty sure you should reach the hill (I had trouble finding that area)
it'll also hover the shovel over spots you need to dig up if you can't find where to dig
if you are still having trouble maybe look up a video if there are any?