Sounds like it might be a bug then. He should either be at the entrance of the Glory Dungeon (well entrance in the town square) or in his sex swing (well entrance just outside Horace's farm). Did notice they just released an update but if that doesn't fix it you should do a bug report to let them know.