Oh damn, that's actually pretty obvious: follow the shadows! For some reason I didn't think about it (only followed the intensifying light when getting close).
