Yeah I have no idea :D that's odd. There are a of funny bugs that pop up in game dev.
I figured out that if I subdivide the surface on blender and create more polygons then I can walk freely. Easy fix but took a lot of troubleshooting!