If you fight the rogue he can get it back, or after a certain amount of time the ghost will leave. It might also be possible to go to the temple to have the ghost removed - I forget if it's in this version or the next and I can't really check right now
Alright :D I really love this update the evil ghost is so cool and hot! I love that when he possesses you he secretly steals your size and that it's hinted at every night after you sleep though I feel bad for the rogue after the ghost leaves him. Their fights are really good and enjoyable but challenging!