Love it -- want to play.
I feel like you've got the start of a great idea, but I feel like you only touched the surface. Instead of the same place being remodeled, the ghost could be trying to clear out an apartment building, and you could have it so that each person the ghost is trying to scare off has different triggers. Some are easy and will flee at the first moving mug, others might take a lot of effort to get rid of, etc.