Oh, that's weird. Pyinstaller can be really quirky. What version of Windows are you running it on? I've only tested it on 10.
Windows 10, using the Windows Insider Preview program (not sure what dev build I'm on atm).