I've had a different experience - LLMs that continue to apologize then make up other wrong shit in a chain of ludicrous wrong shit.
I think of LLMs as world-class bullshitters. They often hold forth with complete confidence on topics they have little or no understanding of, making up what they don't know, and appearing to be experts. Except to somebody who actually knows something.
Like that blowhard friend who has an opinion on anything.