HNHacker News
TopNewBestAskShowJobs

tomhamer

5 karma · joined August 12, 2019

submissionscomments
tomhamer··on Celeris-1: A diffusion LLM benchmarked at 2,082 output tokens/s
Tom here, CEO at Celeris. I'll be around all morning. Ask me anything about the model, diffusion LMs, or the numbers.
tomhamer··on Nixiesearch: Running Lucene over S3, and why we're building a new search engine
I might be missing something but how is this different to amazon opensearch with ultrawarm storage? I think amazon launched this about 4 years ago right?
tomhamer··on Vector Search with OpenAI Embeddings: Lucene Is All You Need
Marqo lets you use state of the art e5 embeddings (which are significantly more performant in retrieval than the openai embeddings), and will handle the embedding generation and retrieval on lucene indexes: https://www.marqo.ai/

It's also available opensource: https://github.com/marqo-ai/marqo

tomhamer··on Vector databases: analyzing the trade-offs
marqo.ai has excellent indexing throughput as vector generation and vector retrieval are both contained within a marqo cluster. You can use it with multi-gpu, cpu, etc. It's also horizontally scalable.
tomhamer··on Vector databases: analyzing the trade-offs
Just to quickly add to ukuina's comment, marqo.ai does embedding generation and vector search end to end, so you can put in documents and the embeddings are automatically generated.
tomhamer··on Vector databases: analyzing the trade-offs
Marqo is an end-to-end vector search engine that handles both embedding creation and retrieval: https://github.com/marqo-ai/marqo
tomhamer··on The fully bootstrapped and vector search engine
Just adding here that if you want a vector DB that handles inference for you too, you can try Marqo https://github.com/marqo-ai/marqo
tomhamer··on Ask HN: Seeking advice on open source end user distributed vector database
Marqo will generate embeddings for you as well as run on a mac/in the cloud. https://github.com/marqo-ai/marqo
tomhamer··on AI for AWS Documentation
Marqo provides automatic, configurable chunking (for example with overlap) and can allow you to bring your own model or choose from a wide range of opensource models. I think e5-large would be a good one to try. https://github.com/marqo-ai/marqo
tomhamer··on Ask HN: Can someone ELI5 transformers and the “Attention is all we need” paper?
Disclaimer - someone from Marqo here.

Marqo supports E5 models: https://github.com/marqo-ai/marqo

tomhamer··on Kdb.ai Vector Database
Someone from Marqo here - if you're looking for an end-to-end vector search DB that handles vector search and transformation you should check out marqo. https://github.com/marqo-ai/marqo
tomhamer··on Ask HN: Seeking a Vector Database for ClickHouse Users – Suggestions Appreciated
You should check out https://github.com/marqo-ai/marqo for an end-to-end vector search database with batteries included.

Disclaimer, I'm from the Marqo team.

tomhamer··on Show HN: Summaries and Q&A for dense financial disclosures
Sounds great! Lets connect on linkedin? https://www.linkedin.com/in/tom-hamer-%F0%9F%A6%9B-04a6369b/
tomhamer··on Beating OpenAI CLIP with 100x less data and compute
UKV looks really cool. At Marqo.ai we are achieving end-to-end semantic search building on top of existing embedding search functionality, keen to take a closer look at what you are doing. Seeing UKV come out on the cloud serverless will be super interesting - it's something thats taken us a while for us to work out.
tomhamer··on Show HN: Summaries and Q&A for dense financial disclosures
This is really cool - would be awesome to connect at some point. I co-founded Marqo which also enables this through providing the semantic search component of this workflow. We've found some interesting results combining it with LLMs. https://www.marqo.ai/blog/from-iron-manual-to-ironman-augmen...