As it states in the beginning of the game, affection and all other stats have nothing to do with a character's level and are only used to unlock additional side content.
A guide is also available on the wiki. To get to level 17, you must buy the dungeon