Hacker News Reader

Comment by xlayn | Hacker News Reader

Remember those gpus into chips https://inference-docs.cerebras.ai/models/qwen-3.8-27b , where you have this chip that implements a model that run at those extremely high speeds... the ones that people ask "why do we need that"... if this is true... one of those chips with the correct harness is all that's needed to get fable like intelligence in every single computer in this planet...

Happy hallowen Tax Ramltman and Amowhateverwayyournameiswritten...

View on HN

> one of those chips with the correct harness is all that's needed to get fable like intelligence in every single computer in this planet

I'm not sure I understand. Are you saying we could put a dinner-plate sized chip that costs millions of dollars and draws tens of killowats of power into every single computer on the planet? Or that a single of these chips could provide inference as a service for every computer on the planet? Because neither of those are even remotely feasible.

it's economy of scales, qwen 3.8 27B regurgitates a lot and that's an intentional tradeoff of space/speed so you teach it patters that can follow for more complex stuff and give it more basic tools that can utilize to build those... the tradeoff comes from the model writting a lot of verbose prose to achieve that.

if the approach works, you have now a viable path to use this complex/hybrid structures where you can pair those chips with gpus and offload whatever is optimum to the model on chip.

Just like you can go and buy a threadripper now (the ram maybe not so much), how much was worth that amount of computing 10 years ago?

Happy hallowen! ::::

Actually we tried Cerebras. It caps output at 32K tokens so the 128K reasoning (the author budget) didn't fit. Cerebras speed is real though

Reply on news.ycombinator.com