I normally readjust on the sprite sheet, in your case I would see if I could make all animations 35x35 or go up as high as 48x48 if need be.It will be easier if everything is as uniform as possible.
