_s_a_m_

We hit rock bottom in the web dev community just now.

Gotta love the word "advanced"

You are comparing apples and oranges. "generating content" does not yet say HOW the data is generated. Here we are specifically talking about probabilistic generative model, which are inherently unsuited for mission critical purposes, as they are engineered right now.

I don't need to do this discussion, this is basic introductory education and consent in University courses about AI and especially about system engineering verification and certification, which is required for most customers on a large scale and mission critical purposes.

> Chatting with random people on the internet is much more unpredictable

Not particularly the best comparison, we are talking here about applications and services which we sell and we have to make sure that we have the confidence that we can trust our own systems and the customer can rely on our word and engineering skills. Right now we are still in the primordial soup of AI. As long as we do not have proper methods to verify and certify our models, they are dangerous and unpredictable.

You can frame anything being "a tool". But if you want to stay within your logic, then this is a very specific "tool", it is supposed to directly interact with people, not machine to machine, and as such it can have consequences which are unpredictable. And no, human to human interaction is mostly NOT unpredictable, we act according to social norms and have common sense, otherwise you're not a proper human.

This is not a new issue but is heavily researched in the certifiable AI area. If you just turning million knobs randomly based on an architecture and the biased data you have, of course you don't really known what you are doing.