HNHacker News
TopNewBestAskShowJobs

bagdaerdev

15 karma · joined July 21, 2026

submissionscomments
bagdaerdev··on Measured LLM inference speeds on Apple Silicon, with raw data (CC BY 4.0)
Fair point. The first run covers what our customers deploy most via Ollama today, which skews to the Llama / Qwen 2.5 / Mistral / DeepSeek families. Qwen 3.6 and Gemma 4 are top of the queue for the next run same method, same raw JSON. Which quants would be most useful to you: Q4_K_M only, or Q8 as well?