HNHacker News
TopNewBestAskShowJobs

dhruv_anand

4 karma · joined May 18, 2023

submissionscomments
dhruv_anand··on Radient – vectorize many data types, not just text
Things are what people call them. Featurization/Feature Extraction used to refer to manual feature engineering, where you could tell what each numerical value is.

Vectorization, as colloquially used by developers in the AI space today, refers to the same thing being done via deep learning models, so it is less to do with ML Features, and more to do with generating a Vector all at once, with each dimension not having a specific meaning.

dhruv_anand··on Radient – vectorize many data types, not just text
for vector sinks, it would be good to integrate with Vector-io (https://github.com/ai-northstar-tech/vector-io) which provides import functions for ~10 vector databases already.

disclosure: I'm the author of Vector-io

dhruv_anand··on Radient – vectorize many data types, not just text
nice library. for text embeddings, it would be good to integrate with a framework like litellm, which has enabled doing embeddings using a variety of methods and API providers: https://litellm.vercel.app/docs/embedding/supported_embeddin...
dhruv_anand··on Ask HN: Is there a need for entity-based RAG?
Can you link to your solution?
dhruv_anand··on Are we at peak vector database?
Is your YOShInOn RSS reader available as an app or open-source library?
dhruv_anand··on Ask HN: Semantic Vector Searching in WASM?
Not sure if this helps, but you can create embeddings using transformers.js (feature extraction pipeline) in the browser.
dhruv_anand··on Qdrant 1.7.0
You can have a look at this sheet: https://docs.google.com/spreadsheets/d/170HErOyOkLDjQfy3TJ6a...

It shows which Vector DBs have a particular feature. "In-built Text Embeddings creation" is a column you can look at.

dhruv_anand··on New ways to find just what you need on Search
They have it. It's called Bard. It's just not as good as one might expect from them.
dhruv_anand··on Show HN: Marbbble, discover alternatives using domains, URLs and keywords
Why not index a DB of competitors. Something like crunchbase or an open equivalent?
dhruv_anand··on Show HN: VectorAdmin – An open-source vector database management system
cool idea!
dhruv_anand··on Any startups working on RAG infra for LLMs?
Perplexity.ai and a whole bunch of other companies are doing this.
dhruv_anand··on Show HN: LLaMA tokenizer that runs in browser
https://news.ycombinator.com/item?id=36105660

Models under sentence-transformers are commonly used by people.

You can check this leaderboard, where OpenAI's embeddings are outperformed by open source ones: https://huggingface.co/spaces/mteb/leaderboard

dhruv_anand··on Ask HN: In-Browser Vector DB?
https://docs.trychroma.com/getting-started?lang=js#:~:text=C...