A passive skill needs to be equipped into a skill slot. You can press F1 during battle to see a list of effects applied to each character, including passives.
The exceptions to this are the "Job Mastery" passives in chapter 1. They are explicitly marked as not needing to be equipped.