HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by namegulf | Hacker News Reader
Full thread
namegulf
·
Is there a Quantized version of this?
View on HN
mordae
·
They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.
namegulf
·
That's right, need a lot of GPUs + memory, anybody experimented with Mac Studio M3 Ultra for this?
Reply on news.ycombinator.com