Comment by thisIsFiner | Hacker News Reader

Comment by thisIsFiner | Hacker News Reader

Parent Full thread

Uh huh 20 years ago everyone denied the use case of the cloud ...grey beards that are all dead now would never allow their cherished benefactor small business owners private data be stored in a homogeneous data center... heard it all every decade when the state management semantics change with the generations of tech bro butt in seats

I am sure this time the Ruby and Terraform script kiddies will hold back progress just like all those BSD admins staved off Linux like they promised to do on Slashdot 30 years ago

Now that this site has no social moat to boast from the other side of, how out of touch yall are is ridiculously obvious

Glad I went with applied physics, electronic and computer engineering degrees. Will take hands on skill setting up experimental research of propagation of information through various physical materials at various power levels over skill in copy paste of ultimately meaningless syntax.

Instead of feeling insulted, you should just refute me. Why are ASICs a desirable alternative to GPU/NPU inference here?

The "baked-in" weight technology you are describing uses enormous amounts of memory. There is not enough SRAM or flash ROM in the world to put a "modern frontier model" on every iPhone, even if you quantized it to 1 bit. It is scarce and expensive, and we are in a global shortage of memory and flash storage.

If we lived in a world where Cerebras, Taalas and Groq could dethrone Nvidia, they would have done it years ago. Turns out, cutting architectural corners has consequences, and they're extremely offputting for the majority of inference providers.

"If we lived in a world where LLMs could work we'd have done it decades ago instead of in the last few years."

I wasn't offended but secondhand embarrassed for you. You didn't think up LLMs before they happened but you're so sure about the future nonetheless.

Because we could make up an x86 we should have by 1896!

I mean frontier like ability with less data.

You're doing the same old IT thing where ya act like your grasp of today is where progress terminates. It's cheesy.

> I mean frontier like ability with less data.

But why would you need an ASIC for that? If you can get frontier-like models into "less data" footprints, just use the GPU.

You don't need redundant memory systems to make it work. No model has to be (or should be!) "baked into" the Apple Silicon SOC.

Reply on news.ycombinator.com