Dismissing the entire technology as "next token prediction" is also silly. It's implying we actually understand LLMs to a great degree when we do not.
I think a little bit of humility for the capability of these machines is warranted at this point.
I think a little bit of humility for the capability of these machines is warranted at this point.
You might as well describe the primary purpose of a for loop as incrementing a counter. It's what it does while incrementing the counter that actually matters.
But it is also not some mysterious force beyond mortal ken and pretending it is inhibits the useful and safe application of the technology.