And I think for such an entity we may be closer to emerging than we like, especially if it can traverse whole internet including this comment and make summaries out of it out of reach to mere mortals.
And I think for such an entity we may be closer to emerging than we like, especially if it can traverse whole internet including this comment and make summaries out of it out of reach to mere mortals.
Why are people talking about it as if it was a bad thing? If I listen to people everyone seems to be dissatisfied with their life as of now, due to work, politics, society and everything else. If AGI was to arrive it would potentially remove those frustrations, right.
We don’t really know what happens next. There are optimistic outcomes that AGI could enable, but this tech is ultimately being built and distributed by humans currently deeply beholden to the system that everyone seems dissatisfied with.
AGI is not some savior that bursts onto the scene and magically fixes problems. There’s a lot of very messy human work ahead of us if we ever hope to integrate it with society in a way that actually removes those frustrations. And this is not a guaranteed outcome.
Our current AI tech is built by and for giant corporations and governments (many of which are dystopian). AI will simply accelerate the vast divide between the haves and the have-nots.
AI is being used to increase profits of corporations, with no concern for the rest of us. AI will allow the elites to rule with fewer messy humans in the loop, who may disobey orders or have sympathy for their fellow humans. AI will blur the distinction between truth and lies, enabling dystopian regimes undreamt of by writers like Orwell. AI will provide a vast toolset for criminals as well.
If you look at the news, horrible trumps positive big time, any day. It may not reflect actual truth on the ground, but AGI scanning internet knows nothing about reality on the street and everything about trending topics and Fox news headlines.
I guarantee you you can't have an objective viewpoint on mankind from just watching internet go and the one you get will be more negative than reality.
With such conclusions, and capability to collapse our society in a millisecond (it doesn't have to be nukes, it can be subtle subversion of financial and societal system for example), you really want a completely unknown and un-understandable entity to judge all of us?