you are right, the game balance is far from perfect :)
But there’s hint: when attacking, towers prefer bigger units. And zombies are bigger than skeletons and pumpkins. And 4 pumpkins will destroy a tower.