Would it be a human issue, if you type something into a calculator and the calculated result is wrong?
Would anyone use a calculator confidently, if the result was randomly generated?
Would anyone use a calculator confidently, if the result was randomly generated?
Many people here tell you to use AI like you use a calculator. With minimal or no oversight, with full access to production systems, etc.
To let a non deterministic tool communicate on your behalf, or give it access to critical systems is evidence enough that a good number of people are not aware of these facts.