Around the time it was pretty common for men and women alike to be called handsome, so it could definitely work as a neutral ground. It was also used for women that fit the “Fem-fatal” statement. Though I see where you’re coming from with attractive being a more generalized term!