Imagine that AI lives up to its promise, gets captured by a handful of corporations, and ushers in a world of untouchable über-oligarchs that de facto rule the world. Would it have been worth it then? Can this problem even be solved?
I personally believe that it's more likely that the current batch of massively overleveraged AI companies go broke in the next year or so as the AI bubble bursts. Hopefully the USA manages to get its democratic shit together enough to not bail them out (as happened in 2008), and they just... stop.
The OSS models are almost at the same level, and are progressing fine. The technology continues to be useful, even if all the oligarchs go away.
I think those open weight models exist because openai, anthropic, and google rule the roost. And I don't think things would continue as-is if those guys implode.
I think things will continue perfectly fine if those guys implode. They didn't invent the technology, they're not the people who are advancing it most (because everything they do is proprietary and undisclosed), and their efforts at commercialising it are just getting in the way of the real research.