3,257 karma · joined April 28, 2015
On top of it though, it introduces a sort of disciplinary sloppiness around whether the program can be reasoned about. It's assumed that prompt `P` works for whatever input `I`, but the concatenated `P+I` is really the full input to the program that produces a desired output. But the only way to be confident about the program's behavior is to exhaust the input space, as no `P+A` tells you anything about how `P+B` will behave. This makes it difficult to leverage an LLM in any process where the desired result is 1. unknown and 2. matters. If the result is unknown it's not clear how to determine mistakes or correct them if they're made. And if the correctness of the result matters it's courting disaster to connect it to a process which is not able to be reasoned about. I think that's why LLMs are primarily being used to assist ideation (which is cool!) or "spammy" use cases like third-tier customer service or listicle generation, and haven't yet broken into any use case where they need to be reliable for complex tasks.
This behavior also discourages any thoughtful people with integrity from applying, and beats it out of them quickly when they do. The streets would be a lot safer with more citizens performing a genuine public safety role with fewer weapons and chips on their shoulders, but the police lobby essentially holds cities hostage by monopolizing the public safety role and strategically withdrawing from that role in protest whenever an insufficiently deferential policy is passed.
On the other hand, criminal justice in the US is anything but. Voters have decided — I think correctly! — that mere theft and drug use don't warrant the kind of punitive, criminogenic long-term caging and low-grade torture that constitutes our penal system, but there is simultaneously little appetite for improving conditions or exploring alternative rehabilitation so that those going down this road can be firmly turned around or given better choices. So the current situation is that our society, given two bad options, is experimenting with accepting a somewhat elevated crime rate in the interest of reducing over-incarceration and the mass human suffering it creates.
Ultimately my feeling is that you pay for everything one way or another. The stolen laptop and broken window are coming out of the extra money made selling a home in an area with artificially constrained housing supply. People save on property taxes but spend more on Ubers to avoid the train full of poor and needy people who have been screwed by the same system. IMO creating a spectrum of options, rather than the constant debate between extremes, would let people narrow in more strongly on the best balance.
Despite not having the bird's sense for electromagnetic waves, I have an understanding that they are there, because humans saw behavior they couldn't describe and investigated, in a back-and-forth with a world that has some capacity to disprove hypotheses.
Additional modalities are really just reducible to more kinds of text. That still doesn't exhaust the world, and unless a machine has some ability to integrate new data in real time alongside a meaningful commitment and accountability to the world as a world, it won't be able to cope with the real world in a way that would constitute genuine intelligence.
For an LLM, this is not even close to being the case. The sum of all human artifacts ever made (or yet to be made) doesn't exhaust the description of a rock in your front yard, let alone the world in all its varied possibility. And we certainly haven't figured out a "model" which would let a computer generate new and valid data that expands its understanding of the world beyond its inputs, so self-training is a non-starter for LLMs. What the LLM is "understanding", and what it is reinforced to "understand" is not the world but the format of texts, and while it may get very good at understanding the format of texts, that isn't equivalent to an understanding of the world.
I also disagree that Silicon Valley represents any kind of solution to this issue. The centralization of power in the Valley is almost more extreme than in the "old world", as multinational companies dominate the industry and destroy competition. Most people will do better for themselves financially by joining the elect of the fiefdoms of FAANG than by fruitlessly attempting to build a smaller company or product, and the big companies keep it that way through massive networks of financialization and regulatory capture.
In order for civic and social institutions, or small self-built institutions, to be attractive to Americans, people who join them have to have some experience of succeeding in their aims, and I think this is less and less the case, as the institutions that already exist suck the oxygen out of the space of potential action.
As can be expected, Haidt and the poster argue that solutions are found at the level of the cell phone and limiting access to it, rather than improvements at the social level where the boomer, gen x, and increasingly millennial generations continue to fail to deliver meaning through the aforementioned institutions.
If Gen Z could look to society and especially older generations for
- interpersonal relationships based on cooperation rather than competition
- work that was meaningfully compensated rather than exploitative
- governments that were responsive to their constituents rather than self-serving
- social support systems that reward rather than punish parenting, or
- religious institutions that delivered compassion and moral goodness rather than prejudice and contempt,
then I think it could be argued that folks could find meaning in these institutions instead of behind a phone screen. Until then the complaints about social decay are almost insulting.
As an example, the article undermines its own argument when discussing China's strict approach. It talks about what happened after lockdowns were lifted as though it meant that the lockdowns themselves were ineffective, and compares that to the US's poorly-adhered-to stay-at-home orders. But if a country is able to keep deaths low until a vaccine is developed, that decreases the total number of deaths. Whether that militates for lockdowns as strict as China's, I seriously doubt. But the article is so intent on making the (clearly false) point that lockdowns were totally useless that it cannot help but fail to grapple in any thoughtful way with the intensity and form of mitigations.
The history of the field is full of people saying this, and then eventually realizing that it does indeed take a lot to fix what's missing. Right now I think we have stumbled on a novel and interesting result, which is that if you statistically collate all of the text in the world then a computer can also generate text that encodes many of the statistical relations present in that text. But I have yet to hear a plausible argument for how this translates to intelligence except that people have an impression that it's "close", never mind that we don't have any stable definition for what it's close to.
I understand the appeal of using the best and fastest means when there are real-world stakes — taking a motorcycle is better than running for many transport scenarios. But the whole point of this is to have fun! Is it fun to hit <tab> over and over?
The answer to "What are LLMs but humans with extreme amnesia and no central coherence?" is that they are not like humans at all, and only resemble them superficially due to our anthropomorphic tendency to infer a mind upon seeing fluent and roughly correspondent text.
There's no doubt that an LLM can uncover whatever is structurally included in its training data, even if that encoding is implicit. What's less believable is that the LLM somehow achieves a grounded understanding of physical aspects of experience purely from streams of raw text.
I think the paper engages in some equivocation here, as the abstract differentiates between "an enormous collection of superficial statistics" and "a coherent model of the data generating process", without admitting that the first should well imply the second. But that doesn't then further imply a "world model" in the sense that we understand it as sentient beings. For us, an internal model is useful, but when our model or texts don't agree with the actuality of the world, the actuality of the world takes precedence. For an LLM there is no distinguishing between its trained representations and an actual exterior place, or even any sense that an exterior space exists.
What is meant by moral relativism in this case I think is merely that morals do not come to us handed down by God or Nature as Chomsky claims, but are a constant choice made by people over a potentially infinite range. But to assert that the morals don't come from God is not to say that morals are not valuable or worth having.
As Foucault puts it, "What is good, is something that comes through innovation. The good does not exist, like that, in an atemporal sky, with people who would be like the Astrologers of the Good, whose job is to determine what is the favorable nature of the stars. The good is defined by us, it is practiced, it is invented. And this is a collective work."
1. http://www.critical-theory.com/read-me-foucault-interview-in...
unc(unc) -> what does this return?