I believe you might have to finish the sidequest for the miko at the shrine to feed all the strays first.
Ahh, thank you!
