6,954 karma · joined December 27, 2018
I've been saying that forever, and I think that anyone who actually implements AI in an enterprise context has come to the same conclusion. Using the Anthropic vernacular, AI "workflows" are the solution 90% of the time and AI "agents" maybe 10%. But everyone wants the shiny new object on their CV and the LLM vendors want to bias the market in that direction because running LLMs in a loop drives token consumption through the roof.
This is just one facet of a broader point. When people talk about a "trade deficit" what they are really talking about is what's known in Economics as a "Current Account deficit". When discussing international trade and Balance of Payments, there are two accounts - Current Account (goods and services flow) and Capital Account (asset and liability flow). By definition, the two must net to zero. That's not an equation, it's an identity. If you have a Current Account deficit then you have an equivalent Capital Account surplus. It works in both directions. For example, foreign direct investment into another country in the form of a loan leads to a flow of funds into the country (Capital Account surplus) and then those funds are used to buy things (import) from the first country or other countries, leading to a Current Account deficit.
"An AI agent is a system that uses an LLM to decide the control flow of an application."
What gets left unsaid is whether current SOTA LLMs actually have the reasoning and planning capabilities to do this reliably. I would argue that except for code debugging tasks and simple research tasks (iterative Googling with a web browser and then formatting the results into a report format) they do not. That may change in 6 months, but right now the hype has gotten ahead of the capability.
Maybe they didn't fall behind in anything, maybe they just did an analysis of what it would cost to train transformer models with hundreds of billions of parameters, to run inferencing on them, and then decided that there was no way to actually be profitable doing this.
99.9% of real world enterprise AI use cases today are for workflows not agents.
However, "agents" are being pushed because the industry needs a next big thing to keep the investment funding flowing in.
The problem is that even the best reasoning models available today don't have the actual reasoning and planning capability needed to build truly autonomous agents. They might in a year. Or they might not.
https://www.anthropic.com/engineering/building-effective-age...
"- Workflows are systems where LLMs and tools are orchestrated through predefined code paths.
- Agents, on the other hand, are systems where LLMs dynamically direct their own processes and tool usage, maintaining control over how they accomplish tasks."
What Anthropic calls a "workflow" in the above definition is what most of the big enterprise software companies (Salesforce, ServiceNow, Workday, SAP, etc.) are building and calling AI Agents.
What Anthropic calls an "agent" in the above definition is what AI Researchers mean by the term. It's also something that mainly exists in their labs. Real world examples are fairly primitive right now, mainly stuff like Deep Research. That will change over time, but right now the hype far exceeds the reality.
> What most agent startups are currently building is not agents, it's workflows, that is "systems where LLMs and tools are orchestrated through predefined code paths." Workflows may still bring some value
While this viewpoint will likely prove correct in the long run, we are pretty far away from that. Most value in an Enterprise context over the next 3-5 years will come from embedding AI into existing workflows using orchestration techniques, not from fully autonomous agents doing everything end to end "internally".
https://en.wikipedia.org/wiki/Hygiene_hypothesis
The basic rationale for it is that the human genome did not evolve in a sterile environment, it evolved in an extremely hostile environment, and so developed pretty harsh defense mechanisms, which if not trained (via early exposure) on the appropriate targets will instead learn to target harmless compounds as well as the body itself.
https://en.wikipedia.org/wiki/Lip-Bu_Tan
https://www.linkedin.com/in/lip-bu-tan-284a7846/details/expe...