I solved this issue by doing "npm run build" and then manually changing the paths in the resulting build folder to be relative. I had "homepage" : "/REMOVETHIS" in my package.json. Then, after doing npm run build, I went through all of the files in the build folder and removed all instances of "/REMOVETHIS/" (note the slashes on both sides). Then it works.