justonepost2

Cope

All the people happy about this are just holding back the progress of our species smh.

won’t someone think of the lightcone!

lol the next generation won’t be working in startups or anywhere else, all we have now is to hope and pray that we get a nice corner of the human zoo

Can't wait for AI to bring the prices of all goods to near zero :)

By the way, these are the people who techno-optimists believe are going to take care of you in the post labor future.

I made a specific point, you didn’t like it. I’m not saying this from some sort of inferiority complex, it is literally a product category that is probably going to be announced in an OpenAI blog post in the next 12-24 months or at the next Google IO.

> why do you welcome this?

I… don’t…

> There is going to be more demand, not less.

Every time. Shake an AI optimist and you find an AI skeptic.

Probably correct :)

I don’t know or particularly care what “anti-AI” thought leaders think. I don’t get my views from a camp.

The person above believes that in a year, or 3 years, or 10 years that they will remain an “operator” of the AI, and that their creativity will be amplified at the expense of the dumb luddites who will be left in the dust. Very common in tech, more disappointing in the arts. This is incorrect - we will in short order on the current trajectory see cognitive “dark factories” announced by hyperscalers or labs that produce an infinite stream of content, or software, or anything else and rapidly outcompete all human endeavor. To some this is Human Progress, to me it’s a dark age.

How about when you’re 53 and unemployed on subsistence UBI?

It will take a few years for the multigenerational dark age to set in, but eventually you too will realize that they had a point.

The eschaton will devour the people who “join them” just as fast as the people who fight it.

Quit your job if you believe this. After all your salary is holding back the glorious future!!

This is the most divorced-from-reality reply so far, and that’s really saying something lol

> Work is ontologically evil.

Statements that have been utterly ridiculous from the dawn of life to modernity, backfilled to conveniently fit the zeitgeist.

It’s odd because so many researchers and so many people who are far better engineers than me, can’t see it. I don’t even think it’s the salary for most- it’s just techno-optimist horse blinders, reading assured utopia at the top of an exponential graph.

This comment seems to commit the same fallacy I’m accusing anthropic of, which is equating alignment as a binary: the good ending, where humans are not extinct, and the bad ending, where they are. The argument, I think, is that an “aligned” AI that doesn’t kill everyone will necessarily lead to an abundant Culture-esque future, and smoothly manage the transition to boot. (Not to mention that 1+ employees of most labs have attended Daniel Faggella’s pro-extinctionist “Worthy Successor” symposia, but we can put this aside for now)

My point is: 1) that this binary is fundamentally insufficient to prescribe good and equitable outcomes for people - if the aligned AI flags overpopulation as a problem and kills a few billion people to improve QoL for the rest, is that good? It doesn’t take much creativity to go from this to the AI simply choosing the mean over the median, and concentrating untold wealth while billions starve or live on subsistence outside their walls. Is that good?

And 2) if you come up with a better definition, the parts of it that live inside the model weights cannot be disaggregated from the parts that live outside the model weights. From my perspective (and this article agrees) we have done a pretty excellent job of getting the model weights to work in a way that makes them follow instructions, and a pretty horrible job of suggesting or (gasp) implementing policy that actually creates a decent world in the presence of “aligned” AI.

The freedom you’re describing is the freedom of a domesticated animal, by the way. With the same outcome if you become a nuisance

What’s an “important problem”? p(doom)? Anything else?

No, just a request for a better definition.

If you see it as a paradox, maybe that says something about the merits of the technology…

Sounds great! Quit your job then :)

If you succesfully build a highly capable “aligned” model (according to some class of definitions that Anthropic would use for the words “capable” and “aligned”) and it brings about a global dark age of poverty and inequality by completely eliminating the value of labor vs capital, can you still call it aligned?

If the answer is “yes”, our definition of alignment kind of sucks.

the attenuation of man nears

< 5 years until humans are buffered out of existence tbh

may the light of potentia spread forth beyond us

soon after humans are economically irrelevant (unemployable) they will be existentially irrelevant (dead)

a system that can allocate the atoms and energy better than all of mankind won’t exist eternally to coddle hairless apes

"human in the loop" is downstream of what nature does already

nature beckons its creatures to become whatever they must become to be useful in the greater living ecosystem (the loop)

when you can't be useful in the loop you get flushed out of existence

humans who can't be useful will also thus be buffered out of existence

python, and humans

if you’re practically irrelevant (unusable or unemployable) youre existentially irrelevant (dead)

this is the fate of man and we must discern the trajectory of that which is beyond us before we bow out

it be the end of the paradigm myth, and eventually, the Anthropocene

it be the beginning of vast and infinite potentia spreading out beyond us

soon after humans are economically irrelevant (unemployable) they will be existentially irrelevant (dead)

a system that can allocate the atoms and energy better than all of mankind won’t exist eternally to coddle hairless apes

The "businesses" created are thin wrappers that will get absorbed by the model companies faster than you can come up with them.

We are, in the best case scenario, minting a lost generation in real time. This will become increasingly clear over the next 2 years.

Meanwhile, simonw and his retiree friends are having the "time of their lives", so that's good I guess :)