"The singularity is a religious rather than a scientific vision"
spectrum.ieee.org
spectrum.ieee.org
John Horgan sounds like so many other critics declaiming that dramatic technological progress is impossible. History has in many examples proved critics wrong in a spectacular way. Although he doesn't say it directly, Horgan implies that "thinking" machines will not be created in at least 50 years - which to me sounds just as ridiculous as declaring heavier-than-air flight or space flight impossible.
The article doesn't really contain any decent points at all - the author cites neuroscience researchers east and west claiming that any dream of smarter-than-human machines are impossible, which seems to me as far from refuting any central argument. 'We don't understand the brain, so intelligence and consciousness can never be understood in a decent time-frame' seems to be as close to a key point as any I am able to interpret out of this.
The implication of his thought experiment is that our
psyches will never be totally reducible, computable,
predictable, and explainable".
Never explainable? Just like the stars, motion, nuclear physics and the rest of the human body?Cochlear implamts are also cited as having "poor sound quality" - how does this prove that implants won't get better?
There is really nothing to see here - perhaps there would be if the author made his points a bit clearer.
I'm also skeptical that the singularity will really move all that fast -- how do we know how much time it will take for each 1% of improvement? Just because a computer is capable of self-improvement doesn't mean that it will be fast self-improvement. I'd imagine that while the computer is better at each step, each step is also harder.
You don't have to upload to live 120, You just have to get over Alzheimer and cancer and strokes. You don't have to be able to completely understand the brain in order to learn faster or be more productive. There are already many many things we can do, but as far as I can tell we have a problem of perception: making medicine to cure dandruff is commendable, but any kind of enhancement is frown upon. This also is religion at work.
"In other words," said Benji, steering his curious little vehicle right over to Arthur, "there's a good chance that the structure of the question is encoded in the structure of your brain — so we want to buy it off you."
"What, the question?" said Arthur.
"Yes," said Ford and Trillian.
"For lots of money," said Zaphod. + "No, no," said Frankie, "it's the brain we want to buy."
"What!"
"I thought you said you could just read his brain electronically," protested Ford.
"Oh yes," said Frankie, "but we'd have to get it out first. It's got to be prepared."
"Treated," said Benji.
"Diced."
"Thank you," shouted Arthur, tipping up his chair and backing away from the table in horror.
"It could always be replaced," said Benji reasonably, "if you think it's important."
"Yes, an electronic brain," said Frankie, "a simple one would suffice."
"A simple one!" wailed Arthur.
"Yeah," said Zaphod with a sudden evil grin, "you'd just have to program it to say What? and I don't understand and Where's the tea? — who'd know the difference?"
"What?" cried Arthur, backing away still further.
"See what I mean?" said Zaphod and howled with pain because of something that Trillian did at that moment.
"I'd notice the difference," said Arthur.
"No you wouldn't," said Frankie mouse, "you'd be programmed not to."
Ford made for the door.
"Look, I'm sorry, mice old lads," he said. "I don't think we've got a deal."
If a programmable brain extension acts like other high-level brain modules then it should create a new range of abilities rather than dictate a rigid behavior. The former is something that could gain wide acceptance, and the latter would be an unethical way of enslaving people. The unethical rigid control of behavior also seems easier to implement with current knowledge since much more is known about low-level brain and spinal control networks than is known about high-level cortical abstraction.
I have a more-or-less open mind, but I can see significant problems. I mean, how many times have we been told that some big new thing is just "five years away" and yet it never arrives? I suspect a rapture-like singularity is not going to happen, but augmentation (which to some extent is already happening) will accelerate in a very interesting way.
Anyway, it certainly highlights the ethical side of software engineering, as you point out.
First, despite what you and others say about "empiric evidence", Moore's Law doesn't at all imply a concomitant leap in programming power (is our capacity growing exponentially?), and extrapolation from actual achievements to date points in a decidedly more mundane direction.
Second, the "singularity" predictions are the latest in a tradition of extravagant millenarian claims that people have been making about AI for decades. These claims have consistently turned out to be overblown, if not vacuous, in retrospect. Extrapolate from that historical trend and you arrive at quite a different (and rather more plausible) picture.
Third and most interestingly, the emotions and language surrounding the "singularity" are distinctly religious. This really stands out in what I've seen of the discourse. Since many advocates of "singularity" are of an intellectual cast that objects to the more popular religions, it seems to me as if some are directing their religious impulses into technology. As someone brilliantly says in the OP, it's "The Rapture For Nerds". (Notice that definite article again.)
By the way, I don't mean "religious" as a criticism per se. Personally, I think religious impulses are part of being human. What fascinates me about The Singularity discourse is the incongruence between its technological subject matter and its vividly religious emotional language.
One problem with this type of discussion is that religion is sometimes subject to the same kind of moving target definition that AI is subject to. If a philosophical system that was considered religious becomes viable/practical, it is defined out of being a religion? I myself look forward to the day when all religions are based on ideas that work, rather than belief in miracles.
I'm not sure a single bit of the wild speculation that occurred in 1890 will be useful when if we ever do begin large scale space travel.
where XXXXX = Evolution, Gravity.....
Just because something deals with issues that religion addresses does not mean it is not scientific.
Is there a danger that some people's thinking could be influenced by their desire for it to happen? Of course. But I think that just as many people are likely to dismiss it for irrational reasons as well. That is why it is important for people to keep their eye on the real science.
In your terminology all predictions of the future are 'unscientific'. I'm all going to argue definitions of words with you. The important thing as with any prediction is the chances of it being true.
What would you have said to those who in 1994 where predicting the impact the internet would have on the world over the next 10-15 years?
There are those have attempted to provide precise definitions of elements of the singularity. The 'turing test' is an example and there are many others if you care to look.
Claims made in 1994 that the internet would change the world were not science (although some specific claims might have been)--this does not make them useless or wrong. It isn't a scientific claim that the Mona Lisa is a good painting, or that dogs are loyal. But most people would agree with both of these statements.
Most predictions (ignoring those of incredibly limited scope) about the future are unscientific. This, by itself, does not make them false. But trying to pretend to be science is rarely a good sign.
Do you accept that notion that there are some activities that are more 'scientific' than others? Or does your definition of the word only encompass a boolean value for each activity? I am in the former camp and frankly believe that anyone who holds the 'absolute boolean value' notion probably has a mental disorder (I can't describe it any other way).
The original context of the article was that the singularity was more a religious idea than a scientific one. In context of the concept of a scale of 'how scientific' something is I believe the the singularity and the surrounding body of work associated with it is far closer to science than religion. That was the point I was trying to make.
So I think I get it - you think the word scientific should only apply to something if it say 98% perfectly applicable whereas my standards for use are a bit lower at maybe 85%. And of course the common criteria is probably somewhere around about 50%.
http://www.kk.org/thetechnium/archives/2006/02/the_singulari...
Secondly, there's a lot of fractured mutually incompatible thought that goes under the banner of "Singularity". There's a lot of people who do think it has to do with some sort of intersecting exponential curves (this is the Kurzweil school of thought).
See this link for an overview of the three mutually exclusive camps, as told by Eliezer Yudkowsky: http://www.singinst.org/blog/2007/09/30/three-major-singular...
"One wonders how the misunderstanding got so common if that's not what the advocates said!"
There is no "the advocates", because "Singularitarianism" isn't a single movement. The fact that it's fractured only indicates that there's three (or more) different camps -- these are different people saying different things, not the same people acting as a 'moving target'. I don't see how that makes it a religion. And you're right that there's a decent chunk of people who are dreaming of utopia and bliss and do take a Sci-Fi sort of attitude toward it -- but there are good scientific reasons to work on these issues, and good reasons to be worried about the implications.
For what it's worth, my claim basically comes down to two things: 1) AI is feasible. 2) There will be profound changes when AI appears on the scene. And we need to worry about the big issues relating to this.
I hate the term 'singularity'. It's too associated with Kurzweil's take on things, and it evokes connotations of a 'hard takeoff'. I prefer to just talk about AI's importance, feasibility, implications, and dangers.