Hacker News Reader

FWIW, 405B not working with Ollama on a Mac M3-pro Max with 128GB RAM.

Times out.

Did you get a 2 bit quant? You need to chain several Mac Studios via Exo to get enough memory for a useful quant to work.