Ask HN: What is the best local model that runs on your Mac at decent speed?

1 pointcarloslfu0 comments

What are your own experiences on this? What mac/specs do you have? what is your preferred AI to run on it? at how many tok/s does it run and how much memory does it take?

I'll start:

I have a MacBookP M5 Pro with 48GB, my favorite model is Qwen 3.8 Flash running at 14-15 tok/s and takes 21-24 GB of memory

View on HN