You are asking for their SEX not their GENDER. They are non-binary which means that even IF they were assigned female at birth (afab) they are not a woman.
And yes it is rather offensive because demanding to know their sex makes it seem like you think that genitals are more important than how they identify. Which is gross. I hope you don't treat real people like this.