Hacker News Reader

For someone who hasn't been paying attention for the last three months, what are the specific differentiators and strengths/weaknesses of Ollama?

How does it compare to llama.cpp or llama-cpp-python, particularly with Metal support?

View on HN

Ollama uses llama.cpp in the background. It's more of a tool to use models: you download models as if they were docker images, you have a centralized way to organize your models, you can create new models with `Modelfile`... It's the docker of AI.

ollama is a wrapper around llama.cpp

Reply on news.ycombinator.com