I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.
4,973 karma · joined October 20, 2014
I love chess, deadlifting, and Elden Ring.
Twitter: https://x.com/frankzliu
LinkedIn: https://www.linkedin.com/in/fzliu
I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.
Even though I'm with Zilliz/Milvus now, I wholeheartedly support and recommend folks check out and try Vespa. Congrats to the Vespa team!
EDIT: For folks on Twitter, you should follow Jo (https://twitter.com/jobergum) from Vespa if you aren't already. Great combo of technical content, hot takes, and vector database memes!
$ pip install milvus
$ python
>>> import milvus
>>> milvus.start() pip install milvusIf you want to create embeddings at the sentence level, a good place to start is SBERT: https://www.sbert.net/
I'm not exactly convinced though, since all the results seem to be purely theoretical or simulated. I would've liked to see a prototype built across several FPGAs with clock speeds extrapolated for ASICs.
pip install milvusMilvus will perform vector similarity search for you - all you need to do is give it a query vector.
I unfortunately don't think we'll be able to solve hallucination anytime soon. Maybe with the successor to the transformer architecture?
My 2¢: don't do a hardware startup. Iteration cycles are long and expensive, funding is minimal, and if you're successful you'll be squeezed out of the market by giants such as Intel.
pip install milvus
Other than that, it's great to see the shout-out for Vespa.For folks who want to learn a bit more, there are examples of vector database use cases beyond semantic text search in our bootcamp: https://github.com/milvus-io/bootcamp
More info here: https://milvus.io/docs/glossary.md#Segment
As great as HNSW and other graph-based indexes are, I think PQ and other encoder/decoder-based methods are still incredibly important for ANN search in general. In particular, it should be possible to learn some sort of joint encoding with neural networks targeted towards different modalities.
In particular, there are 0 mentions of the phrase "machine learning" in The Great Gatsby, so adding one sentence that introduces the phrase should be easy for self-attention to pick out.