I see the confusion. You don't have to use a specific skill to increase it. Any 5 times you succeed at a skill check, regardless of which skills you used, you get to increase any one skill of your choice.
I chose not to make skill checks obvious to make things more immersive. I think it was both a pro and a con. I haven't decided if I'll do that in the sequel name or not.