"Claim level" no, but search engines have been scoring sources on reliability and authority for decades now.
9,214 karma · joined December 13, 2010
"Claim level" no, but search engines have been scoring sources on reliability and authority for decades now.
I hope that you are successful!
But in any case, we're definitely coming up on the need for that.
What is Codex doing differently to solve for this problem?
If a singular agent has a 1% chance of making an incorrect assumption, then 10 agents have that same 1% chance in aggregate.
And at the end of the day it's not the agents who are accountable for the code running in the production. It's the human engineers.
Not to say that there's no value in AI written code in these codebases, because there is plenty. But this whole thing where 6 agents run overnight and "tada" in the morning with production ready code is...not real.
The latest "meta" in AI programming appears to be agent teams (or swarms or clusters or whatever) that are designed to run for long periods of time autonomously.
Through that lens, these changes make more sense. They're not designing UX for a human sitting there watching the agent work. They're designing for horizontally scaling agents that work in uninterrupted stretches where the only thing that matters is the final output, not the steps it took to get there.
That said, I agree with you in the sense that the "going off the rails" problem is very much not solved even on the latest models. It's not clear to me how we can trust a team of AI agents working autonomously to actually build the right thing.
How to use Total Recall. It explains all of the concepts, but lacks a "quick start" section for someone who is ready to get up and running.
OP, I think, is saying that once LLMs start communicating natively without tokens is when they shed the need for humans or human-level communication.
Not sure I 100% agree, because embeddings from one LLM are not (currently) understood by another LLM and tokens provide a convenient translation layer. But I think there's some grain of truth to what they're saying.
The issue is that if you fire off 10 agents to work autonomously for an extended period of time at least 9 of them will build the WRONG THING.
The problem is context management and decision making based on that context. LLMs will always make assumptions about what you want, and the more assumptions they make the higher the likelihood that one or more of them is wrong.
I graduated high school in '04 and even then I was only allowed to use this system called "Galileo" which was basically a curated listed of encyclopedic articles specifically meant for education and research.
I think this is the fundamental thing here with AI. You can spin up infinite agents that can all do....stuff. But how do you keep them from doing the wrong stuff?
Is writing an airtight spec and test harness easier or less time consuming than just keeping a human in the loop and verifying and redirecting as the agents work?
It all still comes back to context management.
Very cool demonstration of the tech though.
I saw someone's analysis a few days ago and they found that their agents were more accurate when just dumping the skill context directly into AGENTS.md
At first the internet was unreliable. Nobody could trust the information it gave you. So teachers insisted that students only use their trusted sources. But eventually the internet matured and now it would be seen as ridiculous for a teacher to tell a student not to do research on the internet.
Now replace "the internet" with "LLMs".
Similar experience. Apparently pretty much ubiquitous with SSRIs
> To post [to Show HN], submit a story whose title begins with "Show HN".
My main hooks are desktop notifications when Claude requires input or finishes a task. So I can go do other things while it churns and know immediately when it needs me.
> So you end up with short paragraphs, sometimes with just one or two sentences
The average number of sentences per paragraph in the article is... 2.4
The new "guidelines" for alcohol are pretty laughable though. I say that as someone who enjoys his fair share of beers. “The implication is don’t have it for breakfast," <- direct quote from celebrity Dr Oz during the press conference.