From GTP-4 (or maybe this is bullshitting too?):
I believe vba616 is trying to point out that if we consider AI systems that
generate plausible-sounding responses to be "bullshitting," then we should
also acknowledge that humans who do the same are not necessarily
distinguishable from "intelligent" humans. In other words, both AI systems
and humans can produce seemingly coherent responses without necessarily
having a deep understanding of the subject matter.
It raises the question of whether we should hold AI systems to the same
standard as humans when it comes to evaluating their output or
understanding. If we accept that humans can sometimes provide plausible yet
shallow answers, should we not also accept that AI systems, like LLMs, can
do the same?