The only other thing I can imagine is not very charitable: intellectual greed.
It can't just be that, can it? I genuinely don't understand. I would love to be educated.
Currently one of the key issues with a lot of fields is that they operate as independent / largely isolated silos. If you could build a true AGI capable of achieving top-level mastery across multiple disciplines it would likely be able to integrate all that knowledge and make a lot of significant discoveries that would improve people's lives. Just exploring existing problem spaces with the full intellectual toolkit that humanity has developed is probably enough to make significant progress.
Our understanding of biology is still painfully primitive. To give a concrete example, I dream that someday it'll be possible to develop medical interventions that allow humans to regrow missing limbs and fix almost any health issue.
Have you ever lived with depression or any other psychiatric problem? I think if we could create medical interventions and environments that are conductive towards healing psychiatric problems, that would also be a massive quality of life improvement for huge numbers of people. Do you know how our current psychiatric interventions work? You try some drug, flip a coin to see if it does anything and wait 4 weeks to get the result. Then you keep iterating and hope that eventually the doctor finds some magical combination to make life barely tolerable.
I think the best path forward for improving humanity's understanding of biology, and ultimately medical science, is to go all-in on AGI-style technology.
I always figured that we will begin to see signs of AGI when a quant firm starts making really outsized returns.
"Hey AGI, how do we avoid being exposed as having implemented AGI?" - Now there is the next trillion dollar and very boring question.
The potential downside is admittedly severe.
Bioscience is the next real revolution IMO. Figuring out our bodies as systems and how to program them will lead to a change bigger than information technology.
But what we need for that is not AGI. Bioscience suffers from a total lack of data. We only mapped the human genome a couple decades ago, and that's overselling it. We are currently in the process of slowly mapping out many proteins and receptors and interactions in the body.
We finally have the tooling to do that. We finally have the understanding to do that. What is limiting us right now is mostly the amount of graduate students being paid to laboriously analyze those proteins and what they interact with and other data points.
Once we have enough of that data, we can approach big ideas and other extremely beneficial models.
Right now we are in the calm before the storm. We are mid-1800s physics, just collecting the data necessary to discover and quantify models of electromagnetic energy and fields, the modeling of which is what directly lead to the information and then computer revolution. Most advancements of the 20th century were about utilizing those models to master the electromagnetic field. Similar data was how we figured out the nuclear forces.
We should be funding the mapping of the human biological system. We should be gathering the data required interact with our bodies.
No amount of "self improving superintelligent AGI" can actually overcome the whole "There's no data" problem. If we had a magical AGI in 1750, it would not have been able to produce Maxwell's equations.
Human minds may be able to merge giving immortality.
Building minds may let us understand our own better and cure diseases.
It’s going to take money, what if your AGI has some tax policy ideas that are different from the inference owners?
Why would they let that AGI out into the wild?
Let’s say you create AGI. How long will it take for society to recover? How long will it take for people of a certain tax ideology to finally say oh OK, UBI maybe?
The last part is my main question. How long do you think it would take our civilization to recover from the introduction of AGI?
Edit: sama gets a lot of shit, but I have to admit at least he used to work on the UBI problem, orb and all. However, those days seem very long gone from the outside, at least.
Expected outcome is usually something like a Post-Scarcity society, this is a society where basic needs are all covered.
If we could all live in a future with a free house and a robot that does our chores and food is never scarce we should works towards that, they believe.
The intermiddiete steps aren't thought out, in the same way that for example the communist manifesto does little to explain the transition from capitalism to communism. It simply says there will be the need for things like forcing the bourgiese to join the common workers and there will be a transition phase but no clear steps between either system.
Similarly many AGI proponents think in terms of "wouldnt it be cool if there was an AI that did all the bits of life we dont like doing", without systemic analysis that many people do those bits because they need money to eat for example.
AGI applied to the inputs (or supply chain) of what is needed for inference (power, DC space, chips, network equipment, etc) will dramatically reduced costs of inference. Most of the costs of stuff today are driven by the scarcity of "smart people's time". The raw resources of material needed are dirt cheap (cheaper than water). Transforming raw resources into useful high tech is a function of applied intelligence. Replace the human intelligence with machine intelligence, and costs will keep dropping (faster than the curve they are already on). Economic history has already shown this effect to be true; as we develop better tools to assist human productivity, the unit cost per piece of tech drops dramatically (moore's law is just one example, everything that tech touches experiences this effect).
If you look at almost any universal problem with the human condition, one important bottleneck to improving it is intelligence (or "smart people's time").
> This is a lovely idea, it truly is. However, if you don't somehow bootstrap AGI, won't "the money" just use (hijack) it to make more money, in the normal dark ways?
> I always figured that we will begin to see signs of AGI when a quant firm starts making really outsized returns.
> "Hey AGI, how do we avoid being exposed as having implemented AGI?" - Now there is the next trillion dollar and very boring question.
In this seemingly undeniable environment, what will be the timescale for our civilization to recover with the media and inference owners having full control of "AGI" - until the benefits finally trickle down to general humanity? 1 year, 10 years, 5 generations, possibly never? Assuming you accept my priors, what is that timescale in your view?
The Orb was never ever ever meant to ever fix anything about UBI or even help it happen.
It was always about creating a hyped enough cryptocoin he could use as an ATM to fund himself and other things. That's what all these assholes got into crypto for, like, demonstrably. It was always about taking investment from fools who could not punish you for screwing them over, and then taking your bag and going home to play.
The orb was a sales and marketing gimmick. There's nothing it could do that couldn't be done by commodity fingerprint scanners.
That's what they've been selling us for the past 50 years and nothing has changed, all the productivity gain was pocketed by the elite
We have abundance. The elite took it all.
Every single dollar gained from increased productivity over the past 50 years has been given to them, by changes in tax structures primarily, and their current claim is that actually we need to give them more.
Because that's all they know. More. A bigger slice of the pie. They demonstrably do not want to make the pie bigger.
Making the whole pie bigger dilutes their control and power over resources. They'd rather just take more of the current pie.
> I hope AGI can be used to automate work
You people need a PR guy, I'm serious. OpenAI is the first company I've ever seen that comes across as actively trying to be misanthropic in its messaging. I'm probably too old-fashioned, but this honestly sounds like Marlboro launching the slogan "lung cancer for the weak of mind".
Cure all disease?
Stop aging?
End material scarcity?
It's completely fair to expect that these are all twisted monkey's paw scenarios that turn out dystopian, but being unable to understand any positive motivations for the creation of AGI seems a bit far fetched.
Assistant robots for the elderly. In many countries population is shrinking, so fundamentally just not enough people to take care of the old.
https://www.smbc-comics.com/?id=2088
It's true. When it comes to the people doing bleeding edge research and development, the answer often is "BECAUSE IT'S FUCKING AWESOME". Regardless of what they tell the corporate higher-ups or put on the grant application statements.
Sure, a lot of people believe that AGI is going to make the world a better place. But "mad scientist" is a stereotype for a reason. You look into their eyes and you see the flame of madness flickering behind them.