Include transgender athletes and record improves a lot. There is no reason why women should be slower than males.
The physical disparity is not a social issue, it's biology; the social component can be argued, however. How we choose to categorize within sports is in our control and opinions will go either way - in my opinion, the separation of men's and women's sports was done to try to correct for that physical disparity caused by biology, if that's undone, I think the top records will be dominated by individuals with biological male sex, regardless of gender, in all categories.