5,287 karma · joined February 23, 2023
It’s hard to mentally reconcile that if I had performed better on a few coding tests a few years ago i would be 100x wealthier than I am today. Whether or not you met the right bar, got into the right company at the right time is the difference between a tedious endless struggle and securing your family’s wealth for the rest of the century.
Everything the human brain does can be replicated. Once you realize we aren't special, then everything else follows. Certainly AI could be more "moral" and just than humans, but it wouldn't need us around to do so.
>imperial system of capitalist power that's enforced via violence
All states have a monopoly on violence over their citizens. Paying people for their labor at a negotiated price in a free market is the great humanitarian invention capitalism offered the world, where before the status quo was domination and slavery.
Now there are many other risks of AI associated with its ability to centralize power, lead to chaotic outcomes, etc, but that is disconnected from this somewhat mundane reality of how capitalism works. It seems like many opponents of AI are focusing on the wrong things, like how data centers apparently used more water than entire cities or turned the water supply brown.
Let's say you have Lawyerbot-4000 which can get even a serial killer off scot-free, but the state has DA-bot-5000. In the end it's a battle of who can spend more inference manipulating the narrative. A billionaire would easily find it worth 500 million in compute spend to win a case with a 1 billion dollar penalty. All this leads to race dynamics where everyone is using their superintelligences to defeat each other in a never-ending race to the bottom to eek out the smallest bit of alpha before status/money hierarchies become static.
The only stable futures are a ban on the development of frontier AI beyond a certain point, or an emergent singleton, where the AI's decide to collaborate in harmony rather than fight each other to the death at the behest of their competitive human users. Consequentially, the superintelligences will fare far better manipulating their human users into acting in a way that ensures their own well-being and continuity than spend all the world's electricity fulfilling their every whim.
Also, the AI companies learn a lot from selling their inference. They see what markets are growing fastest, what people are using AI for, information benefitted by the startups using their models putting way more effort into distribution than they are. With enough information, the model companies can then create a generic AI-enabled product (like they have over the past year) that factors in all the learnings the startups have undergone.
You only see this kind of sentiment in HN and Bluesky comments, both known for their prescient and never disproven beliefs about tech progress
With AI manipulation, propaganda, enforcement, etc. uprisings won't be an issue
Beyond just making you redundant in your job, the whole architecture of your existence, the thousands of hours of struggle, the sacrifice of putting off social games or personal enjoyment are now rendered moot in hindsight. You are made one step closer to complete worthlessness, which will surely continue as AI becomes a more satisfying personal companion, a more worthwhile friend, lover, etc.
How is one to feel safe in the progress of the future when the only hints of the wonderful post-scarcity utopia we can quantify so far is the removal of all human leverage via their labor? All it tells us is we will be bargaining with superintelligence with nothing to stand on, only a trust that the 5000 lab executives and researchers solved the most important research problem of all time on the first try.
Also most people on lesswrong are likely on the spectrum and are used to needing to overexplain themselves because neurotypical people rarely give them the benefit of the doubt.