Hacker News Reader

Does it accept custom openai endpoints and model names?

Would be cool to be able to hook this up with ollama or something local.

From the article: "It adds LLM as a dependency, and takes advantage of LLM’s Python API to abstract over the details of talking to the models. This means sqlite-utils-ask can use any of the models supported by LLM or its plugins"

Ollama is supported in LLM via this plugin: https://github.com/simonw/llm-ollama

Thanks for the info.

I just assumed LLM was a en var manager for openai stuff. But makes sense.

Reply on news.ycombinator.com