It's a fun idea, but you need at least one second of pause, with perhaps an effect or sound to signal before sending the ghost for the player to follow. That lack of delay was more challenging than the level design.