The action check is just to potentially trigger the fight, so if the fight is already marked you can skip the check! Otherwise, you make the check every time you travel to the point, since the enemies are still there.
I'll make a note to clarify this when I have a chance.