putting it in the recycle bin/using task manager to close it should work
edit: apparently you need to hold esc to close it, and you can delete the exe file in the recycling bin to delete it
