218 karma · joined March 15, 2026
Isn’t this affected heavily by adoption of a model? I feel like this might as well be a proxy for how popular a model is.
In any case it’s an interesting concept for a benchmark.
It reduces friction a ton, but at the end of the day I’m not skipping anything.
There are processes at work there that we don’t even have the language to describe.
Humans can “intuit” based on a much larger, if not unlimited, context. Also I just want to say that human cognition is something so insanely complex and deep that we will not understand it at all in my lifetime. To attribute all, or really any, aspects of human cognition to a machine at this point is silly to me.
Maybe it’s the qwerty keyboard or my bad typing habits but certain characters break my flow when typing.
With this, I’m hearing (from supposedly reputable publications, in addition to random people) that this is going to end knowledge work in general and take out a large percentage of the world’s labor force. I’m being told to pick up a trade, and that the career I have and the knowledge I’ve gained is now worthless.
The worst part seems to be that it’s pretty much impossible to quantify any kind of impact these tools will have until after the impact is actually felt. We’ve been in limbo while the tech sector is just rotting.
I can’t imagine most people would be able to tell the difference between Sonnet and GLM 5.2. If the infrastructure around the model you’re using doesn’t change, then swapping models is extremely easy.
Natural language is, however, a prerequisite for the existence of LLMs. It’s more similar to methods for storing and retrieving information, like the printing press or a database, than it is to a sentient being.
That’s not to say that LLMs can’t do crazy things, because they already have. Our language can encode a whole lot of information, and it’s incredible that we’ve found a way to distill that so effectively.
But I fully switched to Fedora a while ago because every game I played was either just as performant or ran better on Linux. It’s plug and play, too. I just downloaded Steam and that was it.
I know there are other commenters saying the same thing, but I’m just super excited because of what this means for Linux market share on consumer machines
The same issues that were present with search-engine self diagnosis are still present with LLMs. If you provide Google with an incomplete list of symptoms and can’t interpret the information you find correctly, you will likely get an incorrect diagnosis. The same is true for LLM output.
EDIT: In long context I mean
I kind of wonder, though, which model they’re using to do the routing. It seems like a huge added cost to do these kinds of checks on every request