Who is "we"? That is not established at all, in fact the opposite is objectively true and widely understood. Chromosomes are the key determinant of "gender", by even the most progressive definition of the term.
This doesn't convince people who see their cultural norms as objective reality tho. hence the controversy.