OK I found something. For some reason after the battle, the name window is not the original one. The plugin store a global name window in Yanfly.nameWindow, which only update when the scene is recreated I guess. Once in battle it is changed but not changed back after the battle ends.