Hacker News Reader

> Is it? Excuse my ignorance. If we were talking about simple Markov chains, aren't these just stationary distributions?

"- You're just a robot, you can't write a poem

- Can you?"

It seems that GPT3.5 is already a much better writer than I am, and I'm still much better than a Markov chain, so LLM's are verifiably better.

View on HN

(Most) LLMs have been trained on more data than any human will ever be able to read, let alone process. Then they have been tweaked to produce human like output (most of the time). They can just as easily be tweaked to produce incomprehensible rubbish. This means that they can generate convincing human like output for any possible combination of data they were trained on and this output will usually be as good or better than that of average modern human that has consumed and comprehended tiny amount of data (in comparison). But even the dumbest of humans can be assumed to understand what they know where LLMs are just giant repository of numbers. LLMs have no capacity to understand what these numbers mean or what their output represents, that requires a human like intelligence. "AI" term has been grossly overloaded (just a couple of decades ago, a complex if/then/else statement was touted as "AI") and as we gain better and better understanding of information science, we assign that term to more sophisticated information systems we build but these systems are still far below of any threshold we would accept as sign of intelligence from another human being. Better term for these system would be Complicated Parrots rather than Artificial Intelligence. Intelligence requires understanding and understanding, I believe, requires sentience.

I find that most people have an incredibly hard time understanding the scale of an LLM's lexicon. I think that scale is always a struggle because it directly challenges our ability to comprehend beyond our own personal/tangible reference frame.

Reply on news.ycombinator.com