HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by drnick1 | Hacker News Reader
Full thread
drnick1
·
Do you recommend Ollama or bare llama.cpp?
View on HN
jboss10
·
llama.cpp It's faster and more open source. Ollama has some mixed history. I use llama-swap to emulate the Ollama experience.
shironnnn_
·
if on MacOS I recommend llm-mlx which currently renders tokens 10%-15% faster than llama.cpp.
Reply on news.ycombinator.com