If we do see a crash and they are sued by shareholders for fraud, perhaps you will reconsider your position.
24,562 karma · joined April 12, 2012
If we do see a crash and they are sued by shareholders for fraud, perhaps you will reconsider your position.
For startups it makes some kind of sense to take risks in this way, for incumbents it makes no sense.
1. Model Build/Training costs are escalating if anything
2. They are in an arms race with competitors and can't afford to stop building new models - if they lose the perception of leading, they lose lots of customers overnight.
3. Inference margin is under attack from more specialised models and open weights models.*
4. They have no moat given how simple the interface to the products is - a bunch of text files and text prompts, and little prospect of building a moat.
So those all run counter the possibility of coasting on previous research. To me the most promising avenue for making money for these companies is to replace Google, not AGI or taking over the world's knowledge work. That would mean they are overvalued. Even coasting on previous research, how long would it take to pay off the money they have spent?
* https://strandsagents.com/blog/amazon-saves-millions-replaci...
OpenAI is coming for google’s cash cow ads business (which is already vulnerable because of their sharp practice).
The more slop you have in your context the sloppier the text you get out will be.
If I want to control how it writes I just put a style_guide.md in the context.
We don't have try to use them as 'agents' to write and understand all the code for us, frankly I wouldn't trust them to do so, they make too many mistakes and foolish decisions about architecture.
Markets do include significant risk and we would do well to remember that.
But everyone has a different view of this, it'll be interesting to see how it plays out.
https://news.ycombinator.com/item?id=50422069
It's really very hard to pin down progress in this domain, companies are definitely targeting benchmarks.
One bit of evidence I would look at is the maths results this last year which have been impressive, that was a huge expensive brute force effort, but it is still good progress.
For proof, look at the fall in VWRL last week correlated with concerns over AI which hit nasdaq.
Imagine how humans would function if we carried our memories around in overflowing notepads and had to consult them every time we wanted to know a fact or remember a person we had met, it would be exhausting and inefficient.
Yes the style is annoying and bombastic, but the objection goes deeper than that; it's annoying to have someone generate text with an LLM from a small outline or prompt, not even edit it for sense, and dump it on readers.
I usually read the comments before deciding if the article is worth my time.
The article explicitly excludes this from consideration early on though:
By “agent memory,” we mean knowledge that Claude gains from experience...saved as context it can read later. It excludes other ways models can learn or manage context, such as changes to their weights
Those seem fundamentally different processes, and adjusting weights does seem a much better idea after all, but then in that world everyone has a different AI and how do you apply updates? For a company like Anthropic this is of course a big problem and that is probably why they don't like that route. Could we store weight deltas or something similar and reapply them over a different model?