3,929 karma · joined February 12, 2024
That's a $250,000 machine for the micro budget. Or if you don't want to do it locally ~$2,000 to do it on someone else's machine for the one model.
To this day I've not seen a phone that felt more responsive than the Nokia N9, which also looked amazing. Yet it was killed pretty much the second it was released.
And baby sit means hire something between a secretary developer that makes sure that important meetings had the record bot invited, gave it a once over and then went back to the 70% of their job that was actual development.
Hunter Thompson literally sat down and typed out every word of Hemingway's novels so he could figure out what good writing feels like.
Why is he allowed to do it in private, but an LLM isn't?
It seems like they are deeply upset someone has figured out a way for a machine to do what artists have been doing since time immemorial.
The biggest productivity boost I ever managed was using Whisper to convert meetings to text and then a big model to summarize what happened.
Then I can chat with the docs and meetings about who decided what, when, and why. It's a superpower that I could only implement because I'm in the C-suite and could tell everyone else to get bent if they didn't like it—and gave babysitters to the rest of the C-suite.
Having visibility and ownership for decisions is a huge deal when everyone has access to it.
That's it.
What people are confused about is what groups of agents are, how they are managed and how they interact with each other.
They are confused because no one is building real multi-agent systems in the open which work.
Trying to build multi-step logical LLMs with the paltry memory we have today is about as effective as trying to play 8k video on a Intel 8008.
All the attention is on the LLMs themselves, which is the same thing as being excited about a CPU in 1970. Sure they are amazing engineering, but you will need another layer on top to make them actually useful.
Historically it was apple that first got the software right. We are now waiting for the first company to get a multi-agent system right - but again thanks to the tiny memories we have because of NVidia it will have to run in the data center, or it will be a decade away.
The mods are universally hated on reddit and they were the ones most impacted by the changes. The average user either didn't notice or stopped getting automatically banned for joining the wrong subreddits.
Adobe kept PDF as a proprietary format from 1992 to 2008. You got the reader for free ... on windows, with a single executable. You didn't get an editor and had to pay through the nose for one from Adobe.
It wasn't until the late 2010s that it actually became a free-ish standard, if you think that a 3,500 page document is a 'standard'.
The only reason why adobe did it is because djvu was eating their lunch, between 2002 and 2008 it was the defacto standard for scanned documents in academia. The documents were easy to edit. The image compression is still better than the native compression on PDF.
To add insult to injury after displacing postscript on windows in the name of security, not only did they add a scripting language to PDF, they added one written in two weeks at a time when it was so bad no one used it for anything but pop-ups and with more security vulnerabilities than you could shake a stick at. I suppose we should be happy Adobe didn't put flash in. Oh wait, they did: https://www.reddit.com/r/Adobe/comments/yqisho/flash_content...
Then pdf came along and said: no this is too dangerous the only thing in a document should be layout information not arbitrary code.
And here we are two decades later.
My hatred of pdf has no end. It killed postscript for dynamic pages and djvu for static pages.
Lets not pretend that the current climate in SF isn't both way outside the Overton window for most of rest of the US and most of California until ten years ago.
The most productive fpga engineer I ever hired was so hopeless with git that I had to hire a second software engineer to babysit him.
After I left both of them got fired and the product they were ahead of schedule on when I left had slipped 2 years behind before it finally got cancelled three years later.
If there wasn't a demand for specifically female engineers they would cost the same as male engineers regardless of the supply because an engineer should be fungible with gender. Unless you think that women have some innate characteristic that makes them better than men?
A dei program labels those people for you.
Ironically this is exactly the reason why dei programs were considered illegal until a decade ago.
The more compute you have to train your models the better the models become.
I've been working on a family of (new) deep learning models which outperform everything else that's been published, at between x1e3 to 1e9 the compute on the same data. If I had the GPT4 training cluster I'd be able to run it on cifar10 without having to make sacrifices, yes 32x32 color images solved with a trillion parameters.
It will get here eventually, but barely within my lifetime and only if hardware keeps advancing the way its been for decades.