HNHacker News
TopNewBestAskShowJobs

alexcg1

96 karma · joined June 19, 2020

Dev Experience Lead at Jina AI - building neural search and generative AI.

I also train AIs to write crappy Star Trek scripts and I build animatronic butterflies

submissionscomments
alexcg1··on Search PDFs with Transformers and Python Notebook
The version in the notebook is just for simple text-based PDFs. I wrote some posts on our company blog[1] about the sheer agonies of dealing with PDF as a data format, so wanted to stick with as simple as possible for now.

That said, I'm planning future notebooks where you can perform text-to-image or image-to-image search, integrate OCR, scale it up, serve it, deploy it, etc.

[1] https://medium.com/jina-ai

alexcg1··on Outsourcing teachers with ML: a search engine for student questions
Why this tech stack specifically and not some other? There's plenty of stuff out there now
alexcg1··on Outsourcing teachers with ML: a search engine for student questions
So much time is taken up on student questions when they could just RTFM. Having an AI take care of that menial bullshit doesn't hurt anyone. There are higher value tasks a teacher can perform then schooling someone who didn't read the curriculum (which this chatbot is based off, after all)
alexcg1··on [dead]
Thanks for posting this! I feel like open source tremendously boosts development speed for loads of projects, and with our growing community and developer team at Jina, things are just getting faster and faster.

At this rate we'll be releasing 4.0 next week

alexcg1··on Show HN: AI powered meme search, open-source
If you search like "animal food" you'll get a lot of memes related to animals and food without specifically mentioning those words (e.g. "dogs" and "eating" in the caption) so it's definitely using a neural net to grok the semantics.

The trigram thing might just be a weird glitch in the pretrained model we're using (sentence-transformers/paraphrase-distilroberta-base-v1)

alexcg1··on Show HN: AI powered meme search, open-source
Hmmm...might be a model thing. We'll look into it
alexcg1··on Show HN: AI powered meme search, open-source
We rely on pre-trained models at the moment, since Jina supports loads of them out of the box.

For image search we use Big Transfer Encoder (https://github.com/jina-ai/executors/tree/main/jinahub/encod...) but may switch to CLIPImage encoder at some point

alexcg1··on Show HN: AI powered meme search, open-source
10k memes are now indexed for text. So if you search for Wonka memes you'll get a lot better results.

Also swapped out the model

alexcg1··on Show HN: AI powered meme search, open-source
We're using Transformers with `sentence-transformers/paraphrase-distilroberta-base-v1` model.

The framework is Jina (https://github.com/jina-ai/jina/) so it's pretty high-level. You can see the indexing/search Flow on lines 37-52 of https://github.com/alexcg1/jina-meme-search-example/blob/mai...

alexcg1··on Show HN: AI powered meme search, open-source
I'm indexing 10k as we speak. At least for text. Indexing 10k images will take a bit longer.
alexcg1··on Show HN: AI powered meme search, open-source
You can see this link. It explains why the meme search still needs a bit of work: http://examples.jina.ai:8501/?tab=Dude,%20this%20meme%20sear...
alexcg1··on Show HN: AI powered meme search, open-source
I'm putting more info here: http://examples.jina.ai:8501/?tab=Dude,%20this%20meme%20sear...
alexcg1··on Show HN: AI powered meme search, open-source
Likely because: a) Only so many meme types in the full dataset b) We only indexed 1000 memes to build a toy example

Had I known it would blow up I would've indexed more!

alexcg1··on Show HN: AI powered meme search, open-source
That's a restriction in the front-end framework unfortunately :(

Really hoping Streamlit supports that in future.

alexcg1··on Show HN: AI powered meme search, open-source
Haha, that's the standard upload limit for Streamlit[1] apps. We just slapped together a quick front-end using that framework.

[1] https://www.streamlit.io/

alexcg1··on Show HN: AI powered meme search, open-source
Since I helped build it, I'll explain :)

This example is quick and dirty, indexing only about 1,000 images from a dataset we pulled from Kaggle. So if results suck, that's due to either the meme you search for not being in the dataset, or it just didn't get indexed in the random batch of 1,000.

alexcg1··on Building an E-Ink Laptop
I've been thinking of something similar: a super lightweight (n)vim machine using Raspberry Pi (originally RaspPi Zero but performance went through the floor with my number of vim plugins, so likely a beefier one).

I think the lack of syntax highlighting is going to be the major hindrance for me moving forwards.

alexcg1··on Show HN: Jina – Open-source AI framework to build search for anything, fast
Thanks! Any framework can seem intimidating at first, but our dev team have put a lot of work into our docs in the past few weeks.

Docs are never really "good enough" imho, but I like to think that ours are "good enough enough" for now (and only getting better )

alexcg1··on Ask HN: Who wants to be hired? (July 2020)
Have you checked out https://jina.ai/#/jobs? We're hiring AI engineers and full-stack developers to work on open-source neural search
alexcg1··on Ask HN: Who wants to be hired? (July 2020)
Have you checked out https://jina.ai/#/jobs? We're hiring AI engineers and full-stack developers to work on open-source neural search
alexcg1··on Ask HN: Who wants to be hired? (July 2020)
Have you checked out https://jina.ai/#/jobs? We're hiring AI engineers at the moment
alexcg1··on Ask HN: Who is hiring? (July 2020)
Thanks! I'll be sure to pass the message along!
alexcg1··on Ask HN: Who is hiring? (July 2020)
We're a cutting edge AI company doing neural search, seeking AI engineers and full-stack developers who actually give a crap about open source.

A lot of people talk a big game about how awesome open-source software is. Not so many really understand its value and believe in it so much that they'd pack in their stable jobs at tech giants and risk it all for an open-source venture. We're in that second group.

A lot of people waste their words complaining about risk averse entrepreneurial and investment culture that hinders the rise of AI unicorns. Not so many want to shake up the system and fix it for the better. I think you can guess where we stand.

We are Jina AI, a venture-backed, well-funded AI COSS company, and we invite you to join us to build the next neural search ecosystem in open source. Will you step up?

https://jina.ai/#/jobs

alexcg1··on A lightweight, customizable omnibox in JavaScript
Alternatively, if you still have problems, we'd really appreciate you letting us know in our issue queue: https://github.com/jina-ai/jinabox.js/issues
alexcg1··on A lightweight, customizable omnibox in JavaScript
Thanks for the feedback Ryan! I'm actually writing about doing product search with Jina right now
alexcg1··on A lightweight, customizable omnibox in JavaScript
Hi there - are you running Jina in Docker on your local machine? We recently updated the docs at https://github.com/jina-ai/jinabox.js/#jinaboxjs-in-action to explain how to get started.

Hope that helps. Let me know if you have any more questions or feedback!

PS: If you still have problems, could you let me know which browser you're using?

← PreviousPage 2 of 2