Hacker News Reader

Hi. Are these ASICs only for LLMs or could they accelerate other kinds of models(vision) as well?

It's a general purpose compute engine for numerical computing and linear algebra, so it can accelerate any ML workloads. Previously we've accelerated models for stabilising fusion reactions and for COVID drug discovery

* https://alcf.anl.gov/news/researchers-accelerate-fusion-rese...

* https://wow.groq.com/groq-accelerates-covid-drug-discovery-3...

So, is this specific chip only for LLMs as the name LPU suggests Language Processing Unit, right?

The chip is capable of running general numerical compute, but because we're focusing almost entirely on LLMs at the moment we've branded it the LPU.

Reply on news.ycombinator.com