They’re the bridge to the frontier models until iPhone 21 ships with then modern frontier model baked into Apple Silicon.
Citation: It Came To Me In A Dream
I am sure this time the Ruby and Terraform script kiddies will hold back progress just like all those BSD admins staved off Linux like they promised to do on Slashdot 30 years ago
Now that this site has no social moat to boast from the other side of, how out of touch yall are is ridiculously obvious
Glad I went with applied physics, electronic and computer engineering degrees. Will take hands on skill setting up experimental research of propagation of information through various physical materials at various power levels over skill in copy paste of ultimately meaningless syntax.
The "baked-in" weight technology you are describing uses enormous amounts of memory. There is not enough SRAM or flash ROM in the world to put a "modern frontier model" on every iPhone, even if you quantized it to 1 bit. It is scarce and expensive, and we are in a global shortage of memory and flash storage.
If we lived in a world where Cerebras, Taalas and Groq could dethrone Nvidia, they would have done it years ago. Turns out, cutting architectural corners has consequences, and they're extremely offputting for the majority of inference providers.
I wasn't offended but secondhand embarrassed for you. You didn't think up LLMs before they happened but you're so sure about the future nonetheless.
Because we could make up an x86 we should have by 1896!
I mean frontier like ability with less data.
You're doing the same old IT thing where ya act like your grasp of today is where progress terminates. It's cheesy.
But why would you need an ASIC for that? If you can get frontier-like models into "less data" footprints, just use the GPU.
You don't need redundant memory systems to make it work. No model has to be (or should be!) "baked into" the Apple Silicon SOC.