Wait, their solution here is not an "agent" at all? It's literally output length of "1", unless I'm missing something? (It's not clear what they are replacing is an agent either, it looks like a reasoning model with no tools that outputs JSON.)
4,583 karma · joined January 30, 2014
Currently building: https://github.com/bottomless/agent-duel
Recently built: http://pellmell.ai
Main squeeze: http://bottomless.com
Wait, their solution here is not an "agent" at all? It's literally output length of "1", unless I'm missing something? (It's not clear what they are replacing is an agent either, it looks like a reasoning model with no tools that outputs JSON.)
If you calculate Elo only before 11/3 and compare to only after 11/3, the Elo is 52 points lower after. Unfortunately we are still in beta so this isn’t conclusive (confidence interval of -160 to +40).
If we do this calculation on all our models, Opus 5.5 is first in apparent drop. (Again, not definitive, but supports the conclusion.
Excellent thought experiment and this helped it click.
Edit: okay I get it, the human acceleration from impact basically asymptotes.
My kids are too young for this, but surely there's a tradeoff here. Should you override some of your child's natural wonder because of adult aesthetics (or worse political concerns)? Yes. But how often? I'm not sure the line should be drawn at a truck design. (Although, maybe you're teaching your kid taste, again I'm not sure.)
To me this is proof of failure of system to educate a sufficient majority of people to think rigorously.
This is surprising to me, given how much acceleration there has been in AI capabilities since the same time last year. I guess costs and risks are accelerating just as fast.
Im not sure if you mean “coerce” literally but if so this is overkill. Maybe “persuade” or to be more critical, “manipulate”?
It's a decent read, the author went on to being a bestselling true crime writer. https://www.goodreads.com/en/book/show/15654.The_Stranger_Be...
Pandemic effect is nothing compared to agentic coding.
Blog post on this: https://micjm.com/blog/hn-hiring-index-agent-duel/
You can remove early voting from leaderboard and they are no longer the same.
Here, DS4.1-Flash and K3.1 are basically tied, with K3.1 being slower and more expensive. Big error bars, though.
Even with error bars, DS4.1-flash is clearly an impressive model.
To my lay understanding, debt means a loan you have to pay back, whereas liabilities are everything you're on the hook for.
Full disclosure: fully vibe coded while working on an agentic engineering tool.
For example, the Great Depression. Hoover was a literal textbook author, but is widely blamed.
The only real professor was Wilson, but he had similar failings to what people in this thread are worried about.