It's because of the shamans (each buff to dmg = slightly larger size). If there's only a few wizards and many shamans, the wizards get large quickly.
Thank you, this will be useful. Perhaps I can try to fight fire with fire.