Hacker News Reader

This would be great at work, but most orgs would never allow some terminal app to connect out to an LLM we've never heard of and have no understanding of the privacy of, especially for difficult to quantify efficiency gains.

Would you ever consider a version that allows redirecting to a locally hosted LLM server?

View on HN

I'm currently using GPT4-o via OpenAI's API.

I've been looking at ollama for a bit and I think I will ship an integration with Savvy at some point.

For enterprises, I think it makes sense to support a company approved LLM API endpoint in addition to local LLMs.

I'm happy to answer any questions you have around privacy too.

Reply on news.ycombinator.com