> Firstly, the capex is currently too high for all but the few.
> This is a rather obvious statement,
Nobody is saying companies have to make LLMs themselves.
SASS is a thing.
> This is a rather obvious statement,
Nobody is saying companies have to make LLMs themselves.
SASS is a thing.
In regards to Private LLMs, the situation has become disappointing in the 6 months.
I can only think of Mistral as being a genuine vendor.
But given the limitations in context window size, fine tuning is still necessary, and even that requires capex that I rarely see.
But my comment comes from the fact that I heard from several sources, smart people say "we tried language models at work and it failed".
However in my discussion with them, they have no concept of the size of the datacentres used by the webscalers.