I'm still working on RAG (been annoyingly ill last while) but you might find this interesting to keep an eye on: https://socontextual.com/

Ollama /JUST/ recently added some (fast) embeddings models: https://ollama.com/library/nomic-embed-text