I like the concept, but I couldn't figure out how to escape the attack of the evil eye so I didn't go far.
You should use your past projection clone and stay as close as possible to it. The eye is checking if you are "going in the past", so to cheat on him you pretend to going in the past.