Ok but I don't have a lot of faith that it will ever be turned back without violence because there are vested interests in keeping everyone swimming in it.
I'm not sure if we're talking about the same thing.
I think an acceptable good-but-not-perfect outcome it one where the "sea" (AI) stinks so bad that enough people get out that there's a viable life outside of it. The thing is people, individually and in aggregate, are lazy and competitive, so self-discipline isn't sufficient to sustain that life. There need to be problems that push people in that direction.
The web is foundational to AI, so that's a place where it's vulnerable.
Here I'm quoting from the website:
> It should go without saying that you should never publish fake content. While my experiment relied on tens of thousands of unverified stats, I ran it in order to share the results with the public, and the website, while still live, now carries a disclaimer.
"now carries a disclaimer" sure suggests it didn't, so "you should never publish fake content" really doesn't seem like a standard the author actually held themself to.
https://talyarkoni.org/blog/2018/10/02/no-its-not-the-incent...
Good behavior that facilitates bad behavior is not, in fact, good behavior. For instance: it's not "good behavior" to hold the door open for gunman hell-bent on destruction.
The AI labs aren't building AI to help humanity, they're building AI to win at capitalism. Which a big reason why the AI is coming for the intellectual, creative labor that people often enjoy, before it comes from the dirty, unenjoyable labor.