I think that's because bakers don't attack at all if they're not in the front, and when they do have an enemy unit right in front of them they only do 1 damage as a sort of last ditch effort since they aren't trained combatants. After all, the unit description says they do their healing "instead of attacking"