471 karma · joined October 9, 2020
Second, I agree with the distinction evals are not enough, and this is dangerously making people reckless, I think the conclusion is still quite incorrect.
There is essentially nothing magical about being human. Our primitive brains were trained on logic, reasoning and processes. An LLM is simply this on less efficient hardware, but, improving at a speed faster than human evolution.
What do we have in the decade ahead? Robotics in every household, models 10x+ faster and more intelligent than today.
Really no significant impact in life sciences, R&D, and 'offline' world / robotics today as of yet, which is where most of the value will live.
1. Right now trades businesses are profitable because of supply and demand. They are profitable, because they are undersupplied.
2. We are assuming robotics stagnates.
But - it is absolutely hilarious.
The only thing I would mention is that building a lot of agents and working with a lot of plug-ins and MCPs is everything is super situation- and context-dependent. It's hard to spin up a general agent that's useful in a production workflow because it requires so much configuration from a standard template. And if you're not being very careful in monitoring it, then it won't meet your requirements when it's completed, when it comes to agents, precision and control is key.
One thing I've noticed in healthcare is for the rich it is preventative but for everyone else it is reactive. For the rich everything is an option (homeopathics/alternatives), for everyone else it is straight to generic pharma drugs.
AI has the potential to bring these to the masses and I think for those who care, it will bring a concierge style experience.
This post explores the difference between "Replica Agents" (biomimicry) and "First-Principles Agents" (optimizing for the objective function). I draw on examples like Amazon's "Chaos Storage" and AlphaGo to suggest that sometimes the most efficient agent workflow looks nothing like the human one.
Curious to hear how others are balancing "legibility" vs. "efficiency" in their agent designs.
I’ve noticed a recurring pattern where we get stuck trying to perfectly replicate a human's SOP (e.g., "click this button, then read this PDF"). While reproducing human workflows is great for trust and "human-on-the-loop" auditing, I argue it often traps us in a local optimum.
This post explores the difference between "Replica Agents" (biomimicry) and "First-Principles Agents" (optimizing for the objective function). I draw on examples like Amazon's "Chaos Storage" and AlphaGo to suggest that sometimes the most efficient agent workflow looks nothing like the human one.
Curious to hear how others are balancing "legibility" vs. "efficiency" in their agent designs.
Simple as this - as to why its just not possible for this to continue.
I could really envision saving an 'AI Workflow' template with integrated MCP clients that will balloon once adoption is reached. Right now adoption is low so its not a priority for them, once it is, they will tack it on.
I really wish this the best of luck its a great concept, but surely you must be thinking ahead to plan for this situation.
My conclusion was senior engineers were better because they were used to managing developers and taking on more managerial tasks building 'LLM Soft Skills' and also frankly fixing mistakes, the junior developers were pressured for speed and had their managers to correct them.
Within 12 months, despite extensive attempts, only the mid level team members remained.
In-fact, in another similar case, an almost identical thing happened to my partner. She was experiencing medical issues and asked her friends, who were doctors. They confidently gave a flurry of knee jerk responses of the cause without carefully considering all the variables I forced the LLM to do. With the guidance of the LLM, we took a local diagnostic at a nearby pharmacy, CORRECTED the pharmacist's recommendation who attributed it to 'the heat', and the problem was solved within a few hours after determining it was related to a magnesium deficiency.
I'm not saying it's perfect out of of the box, but I remember getting excited when OCR medical imaging 5 years or so was 85% as effective as a doctor, now its surpassed human performance and for much the same reasons that LLMs are superior.
The primary mistake of the physician, and most, is their knowledge window is limited, as another comment cites. Also, they tend to, based on my observation be more reactionary. If you're not visibly sick then you're not sick and several studies demonstrate the long-term compounding effects of LDL at these levels without side effects for years.
Again, the argument isn't to replace primary care physicians with self-diagnostic ChatGPT usage, but rather than in the near term we will observe a threshold similar to medical image recognition surpassing primary care physicians specifically and at some point we will reach a threshold where physician interaction is in-fact meddlesome.
> This is exactly why one must read the author before going into their content. What does this even mean?