Not in my experience, no; it turns to face the graveyard. If it's pointing up, the graveyard is in the direction you're facing, if it's pointing down the graveyard is behind you, etc.
Also, if you're really far away from the graveyard, you can always use a juice portal to take you back.
