I think I figured it out.
Run Celeste as administrator.
Oh cheers for that. I'll give it a try again today.