I kind of got the impression that Asterion was fairly young (early teens, perhaps) when King Minos sent him to Daedalus's labyrinth, though that doesn't necessarily preclude anything... as pointed out above if we assume he isn't lying during the drinking game he seems to have not done anything physical, but there are times where it seems like he's playing dumb when the topic of sex comes up so who knows?