Hacker News Reader

Hey all, I'm the author - feel free to ask me any questions about the article!

Are there any approaches to this problem that are distributed perhaps could take advantage of serverless functions type implementation?

Thanks for sharing! I have a question: is there any option for sparse vectors (like tf-idf outputs)?

nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.

https://github.com/nmslib/nmslib/blob/master/manual/spaces.m...

Welcome! Unfortunately faiss doesn't support sparse vectors. If you're using sparse vectors I would either not use faiss (there are better options like Elasticsearch) - or convert them into dense for use with faiss

Reply on news.ycombinator.com