12,799 karma · joined February 16, 2017
The vanilla approach is fine for a personal or toy project, but it's an unmitigated disaster for a project with even a moderately complex UI.
Eventually, the vanilla project becomes its own bespoke UI framework with a bunch of poor design choices because all the complexity that was dismissed as "artificial" eventually gets patched in using a rube-goldberg-machine approach to architecture.
This is entirely Elon's fault. If he just focused on the tech instead of being an extremely inflammatory political activist in his speech and his role in government, nobody would be talking about this.
Sounds like the absolute worst time to rely on a crappy little model that will inevitably hallucinate.
Worse, they don't control for breaking the application's tests.
> Pass rate scores the agent’s final state against the hidden tests we wrote for each task. We do not check whether the agent broke unrelated tests already present in the repository, and a cleaner-side and messier-side solution that both pass the hidden test may still differ on tests they were not graded on.
Any conclusions with respect to token consumption seems pretty meaningless if we're not controlling for the quality of the final output.
Of course, param count and context length are also important because they increase the model's overall fidelity, but a base model without SFT, RHLF etc is effectively useless.
Stated without a hint of irony.
A qualifed researcher would have had their agent perform the talk on their behalf rather than waste everyone's time.
> LLMs appear to learn distributions of representations, they both develop a hierarchy of those representations, both have early layers that process simple features, with later ones processing more abstract concepts, both predict missing information.
This type of superficial comparison isn't very meaningful, it's trivial to liken anything to a human biology in this manner.
A plane and a bird both use wings to produce lift, it doesn't then follow that a bird and a plane are meaningfully similar.
You're conflating being autoregressive with being sequential.
It's not even a question of "winning", the overwhelming share of people that came online after the advent of social media did so for social media - they never had any interest in niche phpbb style forums.
Is there any human institution under the sun that doesn't labor under a litany of such criticisms?
I could believe it, but I'd want to see something a little more concrete.
Beyond that, if you're a billionaire you can just fast track a path to citizenship with a gold card.
Since it's a national security issue, they'll be inclined to enforce aggressively.
But in practice, they are overwhelmingly having the opposite effect, and if we're realistic about the structural incentives that have no practical path to being changed in higher ed, this will continue to be the case indefinitely.
As would be expected. The value of computer science has very little overlap with navigating a typical production code base.