Anyone who argues that LLMs are "just stochastic parrots" fundamentally doesn't understand what neural networks do. The power does not come from sampling from a distributions over words but from the multi-dimensional representation. And it is that that enables LLMs to be more than just mechanisms that produce copies of material previously seen in training.