Hacker News Reader

What if I'm building a service that leverages LLMs for my customers? Would I be able to use an API to upload my customers' data and have embeddings created for that? Or is this not a use case you're building for?

View on HN

Hi yes, that's the idea! The example shown in the demo video uses internal help docs as the "source of knowledge" for embeddings, but the same principles apply to customer data.

Great! Would I be able to provide customers any guarantees about the privacy of their data? Could you create embeddings based on data encrypted homomorphically?

We'd love to learn more about what types of guarantees your customers expect – it's likely we can provide many of them now and will inevitably offer even more down the line. Feel free to reach out directly to noa@vellum.ai if you'd like to discuss!

Vellum currently embeds any text you send it, but to be honest, we haven't experimented with performing semantic search across homomorphically encrypted text and can't speak to its performance. If this becomes a recurring theme from our customers, we'd be excited to dig into it deeper!

Yeah I understand that operating on opaque data might not be one of the first items on your roadmap. Thanks for the quick responses.

Reply on news.ycombinator.com