Thanks a lot for your feedback! Part of that was actually intentional. We usually play Link without caring much about Navi, so I wanted the player to not having direct control and struggling trying to communicate with him, but I understand it might be too frustrating.
