Hacker News Reader

Thank you (and all the adjacent comments). I don't really need so much RAM for my regular work. Running the llms locally would only be for fun and experiments.

I think 32GB might be the best middle ground for my needs and budget constraints.

It's really a pity that you can't extend RAM in most Apple Silicon Macs and have to decide carefully upfront.

View on HN

I ended up ordering a 36GB M3 for similar reason.

I currently run Mistral and a few mistral derivatives using Ollama with decent inference speed on a 2019 Intel Mac 32GB. So I assumed the new one with 32ish should do a better job.

I've tried vision model Llava as well, a bit more latency but works fine.

With Apple's own Mlx things might improve .

Reply on news.ycombinator.com