It's almost as if there is some sort of Platonic ideal of problem solving that we call intelligence, something you can strive for but also someone can poke holes in.
Why not simply use an IQ test? The various multimodal systems coming down the pipe will either improve on taking IQ tests, or stall. If they improve, then they gain more intelligence. If they stall, then they aren't truly intelligent. Just glorified goal to action mappers.
Humans are, by the mere definition of the word, “intelligent”. AI are doing a simulation of that intelligence, the same way a weather model is a simulation of the weather whereas the actual weather isn't a simulation of anything. That doesn't make weather models useless, far from that, but if you trust them blindly when hiking in the mountains, you may end up in a bad place.
> Why not simply use an IQ test?
IQ tests are very limited measurements of what intelligence actually is. Using a thermometer isn't a good way to access the trustfulness of a weather model.
Humans are absolutely not intelligent by definition, that's why words like "unintelligent", "dumb" and "stupid" exist.
The dumbest human is still far more intelligent than any other animal on earth, by construction of our own definition of intelligence.
Of the tests/definitions that separate humans from non-human animals, the three I grew up with were language, tool use, and the mirror test. AI can definitely do the first two — LLMs know far more languages, natural and programming, than I do — and I don't know either way about the third for reasons related to why I am also dubious about how effective it is really.
IMO those tests are not great, and we don't have a meaningful way to put humans and dolphins on the same scale for the same reason you can't meaningfully put a 747 and a Harley Davidson on the same scale for vehicle goodness.
[0] never mind that "race" isn't a real thing
My point is just that we explicitly define intelligence as things humans excel at and other beings don't (and you are right to point out that in the − not so distant − past, the distinctions wasn't so much humans vs other beings but white aristocracy vs other humans).
And we've been doing the same with AI for a while: beating a chess grand master would have been considered an unambiguous proof of intelligence 50 years ago, now I don't think anyone would argue Stockfish is actually intelligent.
Today I realised there's a superficial similarity between mode collapse and confirmation bias. Anyone know if it's just superficial, or if there's a deeper connection?
> Why not simply use an IQ test? The various multimodal systems coming down the pipe will either improve on taking IQ tests, or stall. If they improve, then they gain more intelligence. If they stall, then they aren't truly intelligent. Just glorified goal to action mappers.
It's unclear how useful IQ tests are; there are entirely functional human communities whose members on average perform as badly on some IQ tests as people who need a full-time caretaker because they lack them mental capacity to get dressed or prepare breakfast without assistance. Change the test, those communities suddenly look smart and it's us who look dumb.
The tests have been improved since then, but we've also got problems in the opposite direction — all of the informal measures of intelligence I had growing up are skills where existing AI is now somewhere between a good student[0] (law, medicine, advanced maths, programming) and wildly superhuman (chess skill, languages spoken, arithmetic[1]).
[0] emphasis on "student": you wouldn't want to be treated or represented by a fresh graduate if you could afford better, would you? Nevertheless, if someone told you they had a law degree and a medical degree, this would be considered a sign they were very smart.
[1] when computers were new, they were called "electronic brains"… or rather, when digital computers were new, as the name "computer" was taken from a job that used to be performed by humans.
"The question of whether a computer can think is no more interesting than whether a submarine can swim." - Edsger Dijkstra
"Deep Blue was intelligent the way your programmable alarm clock is intelligent. Not that losing to a $10 million alarm clock made me feel any better." ― Garry Kasparov
I don't care if a statistical model feels anything when analysing pictures of weird lumps to diagnose cancer, I care if it's accurate.
I don't care if a statistical model has hopes and dreams when generating the text of a computer program one textual token at a time, I care if this is risking my future employment.
I don't care if a statistical model has created the same abstraction of the economy that I have when giving me financial advice, I care that it's got a high rate of return at low risk.
I don't care if a statistical model wants to win at chess, or at Go, or at Diplomacy, or at poker, or at paperclip maximisation…
I will care if someone figures out how to do brain uploads, but that's a question for the future.