I'm on the same boat right now and I'm so annoyed after wasting three days starting a new save and getting all the way back to where I was. Masturbating makes the skill go up and it doesn't matter whether you have hearts or not, it will say the same thing pretty much, it just won't specify a character.