Ahh, the Unity Nav Mesh Agent.. Whenever I got some extra time at hand, I always implement my own solution of A* or smth alike, because it keeps doing weird things :D
Keep up the good work!