Hacker News Reader

> When the machine breaks down, society collapses. No one remembers how to fix it.

The example is unrealistic because that's a very easily anticipated single point of failure.

We've been building systems without single points of failure for millennia.

There will never be only one machine. Already in AI we have dozens of models. They come from multiple diverse - unaffiliated! - cultures, countries, and ideologies.

View on HN

i think the point of the article isn’t about the failure of any specific machine or model, but rather the failure mode that arises from the phenomenon of humans switching en masse from doing their own thinking to outsourcing it to machines.

Even then, the existence of many thinking machines helps humans reason about the more complex machines. Think of it as solving a bootstrapping problem.

It is not and never will be a monoculture. Not at the level of which machine is which and not at the level of which machine can help understand the workings of which other machine. It’ll be many machines augmenting our capabilities in many ways.

A pencil is a powerful tool that is horrendously complex thing to make - so many steps to create one. Yet they’re plentiful and we take them for granted.

Reply on news.ycombinator.com