I was using chrome, so unless lag in Firefox was way worse, it happens there too.
Did you do any object pooling? Or is everything being spawned in Realtime? That could definitely cause some lag, but not sure