I dislike the term bullshit because it's use regarding ChatGPT does not match the dictionary version "stupid or untrue talk or writing; nonsense".

If your sentence "LLMs output is bullshit" is wrong you may be better off changing the sentence than rewriting the dictionary to fit your sentence.

I mean you can redefine words if you like, like how young people use sick and bad to mean much the opposite of what they did, which is fine as a fashion statement, but in trying to reason about LLMs it muddies the reasoning. Which of course is often why academics do it - see Hobbes, Calvin 1993 https://www.reddit.com/r/calvinandhobbes/comments/1300k80/ac...