6,608 karma · joined February 14, 2015
This just being an incomplete list or is there another reason you name the last two but not Google?
Granted, there certainly are other unflattering adjectives one could have chosen to describe this instead.
I think closer to truth is: Participation became production.
More people are doing more things (including with instruments) but often times in a digital setting, sometimes more isolated and sometimes much more public (think: Twitch streams where chat is part of the whole social experience in a way that was never true for TV or other live events of that scale). More participatory online and more individualized as consumption, while some older forms of face-to-face amateur participation have become less socially normal or less visible.
This says not so much about music or culture really; it seems fairly aligned with where our lives and how we connect have moved more broadly.
> Electricity has almost always been a public service.
I have no clue where that would be true, if anywhere. Not where I live. I am paying a private company, and the electricity that they are selling me is generated by other private companies.
This is where the napkin math is breaking down in a big way. There is absolutely no reason to assume this will only impact "knowledge workers". Farmers use computers. Farmers will use AI.
In what way is this different to electricity?
I don't think that is the flip side. That's just obviously bad. Everything that is obviously bad, the model makers will also ~notice and work to make better. They seem to be a competent and attentive bunch, on the whole.
I am willing to suck it but the kerning is still killing me. (I love everything about this btw)
Is it? More capability, more demand, higher price. Seems relatively uninteresting. The naming structure complicates it: 3.5 Flash is less comparable to 3.0 Flash than it is to 3.0 Pro.
More generally, $/token + naming scheme comparisons are just confusing: I am not looking for a wordy idiot and I doubt most people are (at least not with what I would consider worthwhile business ambitions). In fact wordy idiots are fairly costly, because we have to consider the large amounts of cheap garbage that they are producing, and if you price your own time somewhat competitively then fairly quickly that's the bigger lever.
Even if we don't consider the last part: How do we price the better model, that can one shot a task without having to go back and forth and spending more tokens or having to fix more bugs later? It is definitely worth something and I think it's quite undervalued right now. What seems to be missing is a better measurement of capability per token. I don't know how that could look like. Maybe something like how we try and measure inflation, some basket of tasks (which then ends up being part of the training data so idk).
We are adjusting, we talk about things. I hope we will keep doing that.
How do you know that?
Scraping websites is literally what Google does best, stringing together information in the pattern of "some people x, other people y" requires 0 AI and could have been done since forever. I find it implausible that otherwise obviously capable models would be reduced to do something akin to just that.
2. We are not interested in how different model naming schemes relate to prices, we are interested in the capabilities. So if you want to learn something about price development you need comparative levels of capabilities, and then look at the prices. 4o is not comparable to 5.5 in the first regard. It is (according to the benchmarks) maybe more comparable to current 5 nano - which is 98% cheaper.
I don't see why Mistral would stop getting better. It will, just more slowly. Eventually it will be good enough, and continue to be good enough.