But one thing Mistral could do is have a free foundational model, and have non-free (as in beer, as in speech) "pro" models. I think they will have to.
Deploy larger, fine tuned variants and charge for them.
There’s a reason we don’t have the data set or original training scripts for mistral
It's like 1.6gb, ones coming are better and smaller https://x.com/EMostaque/status/1732912442282312099?s=20
I think the large language model paradigm is pretty much done as we move to satisficing tbh
I've been trying out all sorts of open models, and some of them are really impressive - but for my deployed web apps I'm currently sticking with OpenAI, because the performance and price I get from their API is generally much better than I can get for open models.
If Mistral offered a hosted version which didn't have any spin-up time and was price competitive with OpenAI I would be much more likely to build against their models.
I suppose they could be the Google to everyone else's Yahoo and Dogpile, but I expect that to be a hard game to play these days.