Ah! Did you move the .exe out of the extracted folder? LOVE2D has some required .dll files that I included in the .zip that need to be in the same folder as the .exe for it to run. If you simply extract the .zip file then run the .exe in that new folder it should work! I recommend downloading the new version anyways to get access to the improvements we made!
I downloaded the new version and launching it gives me a blue screen.