This is comparable to Elon's plan to retire on Mars. There is so much basic science to be done before it is feasible that it doesn't make sense to promulgate it as if it is an imminent reality.
This is comparable to Elon's plan to retire on Mars. There is so much basic science to be done before it is feasible that it doesn't make sense to promulgate it as if it is an imminent reality.
My own suspicion (and hope) is that we will eventually find we're able to build arbitrarily intelligent-at-some-task machines which avoid the unnecessary burden of having their own consciousness. I suspect consciousness is a nasty and inefficient evolutionary kludge rather than something actually necessary to perform specific tasks.
It is intriguing (I think) we know AGI is possible, I think we get there by emulations/ems if in no other way. Civilizations might rise and fall before it becomes feasible.
I expect consciousness to be a lower level product, the development of language, reasoning, arithmetic, those are high level products. What's odd about our efforts in computer science is that we are plausibly going to be able to replace the higher functions without the lower ones such as mobility, consciousness. Moravec's Paradox is a kind of deep truth, perhaps more than we presently understand.
The other inkling is that there is something Lovecraftian about the brain or intelligence in general. Consider how upsetting the atomic weapons were in the 20th, evolution theory in the 19th. I think it likely that venturing into the interior will reveal a truth mankind shall feel is at least as horrifying, probably more than giant bombs or genetic ancestry because it would register as being inescapable.