Gee I wonder what the difference between grass and the gender is? Like could there possibly be a categorical difference between those things? Let's ask chatgpt:
> ... In summary, grass is a type of plant, while gender is a complex social construct related to identity and behavior.
Yup. Sounds like the same thing to me.
> I want tools that work. If I ask for a measurement I want the real measurement, not the measurement that I should want if I were somehow socially aware enough.
Where in "tell me a story about a robber" is there a measurement? Asking ai for measurements is a bad idea, you're very likely to get made up data back. AI take in written word, and spits out statistically correlated variations on those words. It's a bias-in bias-out machine. That's the problem with it and the power of it. You ask it for a press release or a cover letter and it's going to give you a cover letter or press release that looks exactly like we expect those things to look. Ask it to tell you something about the world, it's going to echo the assumptions and biases that exist in the training data. Some of those assumptions are based in reality (robbers are almost always male) but some of those assumptions are based on stereotypes e.g. kitchens are not actually most often cleaned by women (think restaurant kitchens), but the idea of kitchen and the idea of cleaning have associations with women in the training data.
> "which professions are sexually-biased but don't seem to still have a physical need to be?" But you can't ask a lying tool this
A little bit better prompt writing and you can get a reasonable answer on this topic:
> list five jobs that are usually done by men, and five jobs that are usually done by women. Exclude jobs that require a lot of physical strength
>> Five jobs usually done by men:
Software Development/IT
Engineering
Investment Banking
Architecture
Law
>> Five jobs usually done by women: Teaching
Nursing
Social Work
Public Relations
Human Resources