The colliders on the fence worked most of the times but it seems there were parts of it that didn't... Also I'm on a linux so I can't download the game (it has windows only)
Interesting, I haven't found any areas I couldn't go through, and I'll try and make sure to add Linux builds to my future projects for the cool Linux users out there.