Invest in improving your writing skills. It will pay dividends in every aspect of your business.
9,168 karma · joined June 23, 2019
Also made HN Wrapped (hn-wrapped.kadoa.com)
Happy to chat about data, AI, startups, or anything else: adrian@kadoa.com
Invest in improving your writing skills. It will pay dividends in every aspect of your business.
- frameworks
- hardware
- foundation models (OS vs 3rd party)
- evaluation & training data
Did the performance gains justify the investment for fine-tuning?
[0] https://www.ycombinator.com/companies/industry/hard-tech
- transcription
- machine translation
- OCR
- image recognition
[0] https://www.ifixit.com/Guide/Data+Connector++Replacement/147...
[1] https://chatgpt.com/share/e52dc4dd-77e6-48a5-a7ca-77e3dfa39e...
- No more vendor lock-in
- Instead of just wrapping proprietary API endpoints, developers can now integrate AI deeply into their products in a very cost-effective and performant way
- Price race to the bottom with near-instant LLM responses at very low prices are on the horizon
As a founder, it feels like a very exciting time to build a startup as your product automatically becomes better, cheaper, and more scalable with every major AI advancement. This leads to a powerful flywheel effect: https://www.kadoa.com/blog/ai-flywheel
Meta's goal from the start was to target OpenAI and the other proprietary model players with a "scorched earth" approach by releasing powerful open models to disrupt the competitive landscape.
Meta can likely outspend any other AI lab on compute and talent:
- OpenAI makes an estimated revenue of $2B and is likely unprofitable. Meta generated a revenue of $134B and profits of $39B in 2023.
- Meta's compute resources likely outrank OpenAI by now.
- Open source likely attracts better talent and researchers.
- One possible outcome could be the acquisition of OpenAI by Microsoft to catch up with Meta.
The big winners of this: devs and AI product startups
> Off-Topic: Most stories about politics, or crime, or sports, or celebrities, unless they're evidence of some interesting new phenomenon.
Here is what I rely on as a founder who does a lot of context switching:
- a never-ending text file for todos and work journal [0]
- calendar for planning (and blocking focus time)
- website blocker
- turned off notifications
I fully agree. I realized this early on when experimenting with GPT-3 for web data extraction. After posting the first prototype on Reddit and HN, we started seeing a lot of demand for automating rule-based web scraping stacks (lots of maintenance, hard to scale). This eventually led to the creation of our startup (https://kadoa.com) focused on automating this "boring and hard" problem.
It comes down to such relatively unexciting use cases where AI adds the most value.
AI won't eliminate our jobs, but it will automate tedious, repetitive work such as web scraping, form filling, and data entry.
We have a customer who has hundreds of thousands of unstructured and diverse PDFs (containing tables, forms, checkmarks, images, etc.), and they need to accurately convert these PDFs into markdown for RAG usage.
Traditional OCR approaches fall short in many of these cases, so we've started using a combined multimodal LLM + OCR approach that has led to promising accuracy and consistency at scale (ping me if you want to give this a try). The RAG system itself is not a big pain point for them, but the accurate and efficient extraction and structuring of the data is.
Of course, I'm not going to do it and it's probably extremely hard :)
Can we expect any changes in this area at all? Can anyone point me to some resources?
Facebook's reputation was at the bottom, but now it seems like they made up for it.
Would you mind sharing a bit about your pivot? I always find these stories interesting!
It's a very special place that successfully avoided its "Eternal September". I hope dang knows how much we appreciate his work to not let the quality go downhill.
AI is useful and not just hype, but we don't see any larger shifts in the labor market or economy.
Will AI automate tedious repetitive tasks, such as form filling, data analysis, and data entry? Yes, absolutely.
Will AI take your job? Unlikely, at least in the near future.
For example, we focused on the boring and hard task of web data extraction.
Traditional web scraping is labor-intensive, error-prone, and requires constant updates to handle website changes. It's repetitive and tedious, but couldn't be automated due to the high data diversity and many edge cases. This required a combination of rule-based tools, developers, and constant maintenance.
We're now using LLMs to generate web scrapers and data transformation steps on the fly that adapt to website changes, automating the full process end-to-end.
Having the collective knowledge of the world in my pocket and a personal tutor for any topic still sounds surreal.
One controversial point that has led to discussions in my team is this:
> A common anti-pattern/code smell in software is the “God Object,” where we have a single class or function that does everything. The same applies to prompts too.
In theory, a monolithic agent/prompt with infinite context size, a large toolset, and perfect attention would be ideal.
Multi-agent systems will always be less effective and more error-prone than monolithic systems on a given problem because of less context of the overall problem. Individual agents work best when they have entirely different functionalities.
I wrote down my thoughts about agent architectures here: https://www.kadoa.com/blog/ai-agents-hype-vs-reality
We've come a long way since, but some (UX and tech) challenges remain the same.
[0] https://techcrunch.com/2016/05/29/why-do-chatbots-suck/?gucc...
The WebArena leaderboard[0], which benchmarks LLM agents against real-world tasks, shows that even the best-performing models have a success rate of only 35.8%.
[0] https://docs.google.com/spreadsheets/d/1M801lEpBbKSNwP-vDBkC...
In fact, my own startup wouldn't exist if I hadn't made a HN post with a crappy MVP and received feedback from founders, investors, and potential customers.