LLMs are designed to create “helpful” and “convincing responses” without any overriding guarantees regarding their accuracy or alignment with fact. Right in the chat interface for chat-gpt is says, “ChatGPT can make mistakes. Consider checking important information.”
I’m sure accuracy will improve but it’s not a strong point for the current generation nor was it ever intended to be.
Not coming at you, just trying to support your point.
In my mind the fact that publishing houses are being co-opted (and I’ve seen it too) with this generation of LLM is more social commentary about the sad state of modern news and publishing. Imagine what happens when the LLM technology hits initial degrees or human equivalence.