1,380 karma · joined October 1, 2019
And it's embarrassing. The KiwiFarms exchange with New Zealand after the Brenton Tarrant shooting (are you even allowed to mention his name? Hope I'm not getting you in trouble here) was one of its prouder moments.
What makes HE well-positioned to be able to determine what constitutes a "legitimate safety concern"? What happens when a pro-life organization or a corrupt politician starts leaning on ISPs to enforce their own views of what constitutes a "legitimate safety concern"?
Cloudflare denied service to KF on an imminent threat to people's lives, which could have been justified on a short term basis. Their refusal to reinstate service months later strains the credulity of this rationale, and shows that it was never really the goal.
I'm going to guess that if we ever get a post-mortem on what really is happening inside HE, what we'll find is not "a well-reasoned, dispassionate debate occurred and a consensus was reached in favor of censorship". Instead it will be like "someone powerful in the company made a unilateral decision and dissent was absent because everyone understood that it would have negative career consequences."
>It feels like private companies are de facto writing the laws about what's allowed online and in society right now, and that it's almost become a loophole for censoring free speech on a whim.
"Feels like"? This is clearly embraced as a necessary step to preserve democracy by a small-but-powerful segment of population.
Good point, maybe the private financial institutions (or more!) of the country should lean into this and offer a shadow legal system whereby anyone can bring suit for any allowable reason with the ultimate threat being a sort of (nonviolent!) exile from digital society. That could surely not go wrong.
Untrue, but once enough people know this I'm sure it'll be taken out again. I'd post the link but I'd probably be jeopardizing my YC account..
I'm sure many, many more suicides could be linked more strongly to any of the major social media platforms.
In any case, the reasons for deplatforming have always been more diverse. CloudFlare dropped KF for representing some sort of imminent and ongoing threat to human life which you'd think a good-faith review of would indicate was misguided (and thus their service should be restored.) KF has not been able to establish relationships with other hosts not because literally everyone finds them repugnant, but because entering into a public relationship with any company immediately makes that company a target for a hate campaign, and even "free speech" hosts and such have found the cost-benefit math unfavorable.
It's hard to play out a scenario where this leads to actual human extinction.
Amusing, usually rationalists are made fun of because the concerns about Roko's Basilisk are not performative.
The intelligentsia hates Musk far more than Zuckerberg right now, and will cheer on anything that could potentially hurt him. There's also some wishful thinking that Threads will institute the sort of mass censorship of right-wing speech that was present on Twitter, but it seems unlikely that there will be very different standards than what you see on Facebook, which is often derided as a right-wing boomer-infested hellscape.
I think we underestimate the intoxicating lure of human complacency at our own peril. If I think there's a 90% chance that AI will kill me in the next 20 years, maybe I'd be doing this. Of course, there is a knowing perception that appearing too unhinged can be detrimental to the cause, eg. actually instigating terrorist attacks against AI research labs may backfire.
But if I only think there's a 25% chance? Ehh. My life will be less-stressed if I don't think about it too much, and just go on as normal. I'm going to die eventually anyways, if it's part of a singularity event then I imagine it will be quick and not too painful.
Of course, if the 25% estimate were accurate, then it's by far the most important policy issue of the current day.
Also of course there are collective action problems. If I think there's a 90% chance AI will kill me, then do I really think I can bring that down appreciably? Probably not. I could probably still have a bigger positive impact on my life expectancy by say dieting better. And let's see how good humans are at that..
And maybe you're fine with betting your life on that, but the people who are more-hesitant on this are not crazy.
Who would have to own the data centers for Yudkowsky to support "throwing money at profit-driven AI development"?
If it could do this, then we should seriously question whether it's actually a bad outcome.
This is what a lot of skeptics fail to appreciate imo: That yes the current generation of models are not threatening, and on their own they probably never will be. But there will likely come a point where they can be used to recursively self-improve, and that can potentially lead to very dangerous scenarios.
I'm not sure I'd call it reward hacking when everyone understands that LLMs are just trying to engage in text prediction and that this can often be a poor proxy for trying to generate "useful" text. A paperclip maximizer that ends up turning the world into paperclips rather than creating a new cool paperclip factory has an alignment problem, but it did not reward hack.
As pessimistic as the current zeitgeist is, very few imagined futures reasonably result in actual human extinction.