It isn't. It's said in the game that the elf population is declining. But there is a minimum of 1 male elf. It also mentions elf flipping, where you take weak (male) elves and make them stronger to then sell them. So canonically, males do exist.
