> One way of looking at human creativity is as a process of pulling balls out of a giant urn. The balls represent possible ideas, discoveries, technological inventions. Over the course of history, we have extracted a great many balls – mostly white (beneficial) but also various shades of gray (moderately harmful ones and mixed blessings). [..] What we haven’t extracted, so far, is a black ball: a technology that invariably or by default destroys the civilization that invents it. The reason is not that we have been particularly careful or wise in our technology policy. We have just been lucky.
Try to pull one out and you get a web of affordances and side effects and unforeseen interactions stuck to it
If we were to be wiped out by our technology I see no guarantee some extradimensional coroner would be able to point definitively to just one
Say it's climate heating, rapid-onset Venus mode. Was it the internal combustion engine? The coal plant? The automobile? The wheel? Language? Money? Industrialism? The limited liability corporation? How do you pick one?
No technological form exists in a vacuum, likewise Technology is neither a monolith nor a ball pit of functionally independent atoms
Also some balls (e.g. nuclear weapons, stray asteroids) make it a lot easier to point to something immediate and mostly unambiguous
I agree the analogy isn't perfect, but one can say that despite technologies not having a discreet origin, we can reason about them in retrospect. So maybe modern artificial neural networks were initially made possible by improvements in microscopy and experiments in cell culture to deduce the mechanisms of biological neurons, but we can reason about ANNs as a technology that is changing what is possible by a machine.
I imagine Nick would also be inclined to be fatalistic about technological progress, in that these "black balls" will inevitably be found. His main stance is that we should be enacting the global ethical frameworks around these technologies much quicker.
Yes, agreed, good point
I also agree about Nick's probable fatalism, and I think his work is brilliant and valuable, however one thing irks me. He's made a successful career out of hypothetical "black ball" speculation while saying little about the potential for blackness of the tech we already have. He frames existential risk as if we are on the cusp of dramatic danger but still relatively safe. In truth we are already over the cliff & falling rapidly
Take his paperclip maximizer. They already exist! We need not wait for some future AI to realize a badly misaligned objective function. We're already determined to transmute the remains of our homeworld's long dead into plastic and atmospheric carbon
That's a black ball.
A very popular story but it was also primarily 1 of the 8 scientists working on the Manhattan project and only because he hadn't had all the math showing how incredibly unlikely it would be shared with him. It was already a settled "No, not going to happen." before the first test was conducted. The story ends up being a popular soundbite but with no real teeth on it. [0]
[0] https://blogs.scientificamerican.com/cross-check/bethe-telle...
Oddly, this is kinda freeing in a nihilistic way. If you know that you and your species are going to die eventually (which you do, the eventual fate of the universe is heat death), you can focus on living for the present instead of brooding on the inevitable death of mankind, and just be grateful that you and your species happen to be alive at this particular time on this particular planet where life is actually a thing.
Space is big. Earth is old. When all is told, we just don't know.
"THEY sent A SLAMHOUND on Turner’s trail in New Delhi, slotted it to his pheromones and the color of his hair. It caught up with him on a street called Chandni Chauk and came scrambling for his rented BMW through a forest of bare brown legs and pedicab tires. Its core was a kilogram of recrystallized hexogene and flaked TNT."