For anyone that is running into this problem. I was able to solve it by turning off "data caching" for the Unity web build player's publishing settings.