Maintaining the illusion is important to keep the money flowing in.
Maintaining the illusion is important to keep the money flowing in.
But if it were so settled and obvious there would be a clear line of reasoning to make that plain. And there is not. Instead, there is a very vibrant debate on the topic with tons of nuance and good faith (and bad) on each side, if we want to talk about sides.
And, of course, one of the implications of this very real and significant inquiry that needs to be made and that requires real contributions from informed individuals, is that whenever anyone is dismissive or reductive regarding the unresolved difficulties, you can be sure they have absolutely no clue what they are talking about.
Not sure why I would need to. I'm general, arguments can simply be understood. If they are good, good. If not, then fix them or move along.
Good and bad faith are about people, not arguments.
In part, whether conscious or not, people see the bright future of LLMs as a kind of redemption for the world so far wrought from a Silicon Valley ideology; its almost too on-the-nose the way chatgpt "fixes" internet search.
But on a deeper level, consider how many hn posts we saw before chatgpt that were some variation of "I have reached a pinnacle of career accomplishment in the tech world, but I can't find meaning or value in my life." We don't seem to see those posts quite as much with all this AI stuff in the air. People seem to find some kind of existential value in the LLMs, one with an urgency that does not permit skepticism or critique.
And, of course, in this thread alone, there is the constant refrain: "well, perhaps we are large language models ourselves after all..." This reflex to crude Skinnerism says a lot too: there are some that, I think, seek to be able to conquer even themselves; to reduce their inner life to python code and data, because it is something they can know and understand and thus have some kind of (sense) of control or insight about it.
I don't want to be harsh saying this, people need something to believe in. I just think we can't discount how personal all this appears to be for a lot of regular, non-AI-CEO people. It is just extremely interesting, this culture and ideology being built around this. To me it rivals the LLMs themselves as a kind fascinating subject of inquiry.
What is experience? We are in state S, and take action A, and observe feedback R. The environment is the teacher, giving us reward signals. We can only increase our knowledge incrementally, by trying our many bad ideas, and sometimes paying with our lives. But we still leave morsels of newly acquired experience for future generations.
We are experience machines, both individually and socially. And intelligence is the distilled experience of the past, encoded in concepts, methods and knowledge. Intelligence is a collective process. None of us could reach our current level without language and society.
Human language is in a way smarter than humans.
Your brain is several orders of magnitude more complex than even the largest LLM.
GPT4 has 1 trillion parameters? Big deal. Your brain has 1 quadrillion synapses, constantly shifting. Beyond that the synapses are analog messages, not binary. Each synapse is approximately like 1000 transistors based on the granularity of messaging it can send and receive.
It is temporally complex as well as structurally complex, well beyond anything we've ever made.
I'm strongly in favor of AGI, for what it's worth, but LLMs aren't even scratching the surface. They're nowhere close to a human. They're a mediocre pastiche and it's equally possible that they're a dead end as it is that they'll ever be AGI.
But then you get into the nuance of spiking vs non spiking neurons etc, which to my knowledge isn't emulated. The brain is extremely complex. I don't believe LLMs do anything similar to inhibitor neuronal function for example.
The amount of hubris we have in our field is deeply embarrassing. Imagine a neuroscientists reading that. The thought makes me blush.
It's our field that are the alchemist mystics, rambling about AGI/Philosopher's Stone in ever increasingly unhinged ways, while stirring our ML-pots that we have never even tried to prove have a chance to be anymore successful than the alchemists.
> It's _our field_ that are the alchemist mystics, rambling about AGI/Philosopher's Stone in ever increasingly unhinged ways,
These "ramblings" are what scientists call hypotheses. The people making these hypotheses have even proposed how to test them.
"Neuroscience is the study of the nervous system, the collection of nerve cells that interpret all sorts of information which allows the body to coordinate activity in response to the environment."
https://openbooks.lib.msu.edu/introneuroscience1/chapter/wha...
This is even simpler than the RL agent description of the brain that visagra provided earlier, ignoring that the brain must have some internal state instead of being a pure function from each input to each response. Would you say that neuroscientists have even more hubris?
Have you not understood by now that my critic of our field's AI-hubris is a general one - and thus not hinged on exact wordings? I could've written similar hubris related replies on multiple other comments in this thread. It's my reaction. It's my exasperation.
I think it does, and I've explained exactly how but you just pivots to snarky comments on specific words instead - first scientists, then magic, then oversimplified. Furthermore you seemingly can't accept no matter how many times that it's not specific to this particular comment but meant as a response to the general "AI-hype. So judging by this you're either wilfully obtuse or completely unable to read between the lines no matter how many times I explain it to you. Did you miss that all sibling comments to mine seemed to - shockingly - be able to react the same way I did - albeit less exasperated? But somehow you're completely unable to accept that reaction.
Seriously though, to make my general non-comment specific point for the last time; just do a Occam's razor on the "AI"-hype timeline between if it's a bog standard self-interested tech-hype, using the same methods but with more hardware, or an extraordinary scientific breakthrough justifiably triggering all the extraordinary claims about AGI being close and even an existential threat (!). I think it's the former. If you think that the latter is likelier, fine, but I do think that that requires an embarrassing combination of hubris & confirmation bias because it strokes our egos.
I assume that you're invested in this hype and has taken offense by me calling it embarrassing hubris. I hope you'll be okay when this bubble inevitably bursts. I'll leave it to it now, since I think I've made my general point even though it's clear that it will never be acknowledged.
Did you miss all the upvotes that my comment and responses to sibling comments that show that your reaction is completely out of place?
> to make my general non-comment specific point
OK, so you have no justification for your reaction to Visarga's comment, just as I and the voters suspected.
Added emphasis, and others reacted the same way. You can disagree with the interpretation but to like disallow it like you seem to be attempting is really weird.
you mean by picking the intro one-liner from a textbook? haha, pathetic. whatever floats your boat mate.
Consciousness?
What I say is not just regurgitation of my past experiences; there is a logic to it.