This is unfortunate but also true. Which is exactly what Damore might say about the distribution of this or that attribute among women being shifted from that of men. I don't see the point of lining up a true statement with Damore's when I believe you are claiming his statement is false.
I also don't see what makes the wording "weak." There's nothing weak about trying to describe something in a nuanced way. And it's perfectly possible to be pro-diversity while also claiming what Damore has claimed, in the same way that it's possible to support BLM while also believing that more black people go to prison (your example).
> He claims that it's not all women, just distributed averages (so the typical woman) on a whole.
Please just say this next time. This is the hypothesis that Damore actually backed, and if it turned out to be true it wouldn't prove anything about any individual woman. It wouldn't even prove anything about any select subset of women, insofar as that subset was not selected randomly. It's positively tame compared to the claim that so many are quick to mis-attribute to Damore: "All women are less capable of X, Y, or Z"