Ok, I found the issue. I didn't know you could go further east from the area below the well since you need to be in a very specific spot to trigger that combat, so I thought it was just a wall.
I'll carry on then.
Also, it's not shown that you are cursed in the overworld (apart from the red screen every couple steps). You should add an icon next to the lifebar in the menu or something.