There are actually 2 ghosts in the game. One is Zoe whose been murdered in the office & another is more sinister ghost that you've met before. You can find Zoe working at her desk after 10 pm in the office while that sinister ghost shows up randomly if you walk in the empty office after 10 pm.
So, if you don't want to meet the ghosts, leave the office before 10 pm.