Hacker News Reader

I love working with Ollama, I was really surprised at how easy it is to build a simple RAG system with it. For example: https://github.com/stephen37/ollama_local_rag

View on HN

Nice, I've been looking out for something like this! What's Jina AI and how is it local if I need an API key for it? Also, this is the first time I'm hearing about poetry. Might be worth including in the prerequisites (unless I can just stick with pip?)

> What's Jina AI and how is it local if I need an API key for it?

Looks like its a vector DB used for creating and looking up embeddings (vectors). LLM is the second part of RAG, the first part is having a good embedding model.

Oh yes good point, it's because at first I was using a local embedding model and then decided to use JinaAI as they have good embeddings.

Jina AI is doing different things but one of them is having embeddings and I use their English/ German embeddings as in one demo I am working with German data.

You can use pip as well but yes, let me add something about Poetry in case people don't know about it :)

Reply on news.ycombinator.com