HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by gobdovan | Hacker News Reader
Parent
Full thread
gobdovan
·
> These projects exist, but aren't getting amplified.
Name them
View on HN
tempoponet
·
Most popular would be Qwen 9b or Qwen 35b with experts offloaded to CPU. Even these aren't great, but they can be run at higher quants on lower hardware. We'll see what Qwen releases version 4 in the coming weeks.
majorchord
·
there is also
https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf
Reply on news.ycombinator.com