Note taken!
You can raise your Agility by training with the dummy in the backyard during the day. Or with the pumpkin dummy near the house outside the walls at night. Also you can get a couple of points if you do the peep minigame.