I kind of get it though, presumably a large number of people here have paychecks that depend on him being wrong, or least the perception that he's wrong for a while.
I was thinking earlier that it's mildly fascinating how some people are more annoyed by the hype, and others by the anti-hype. Thought it'd be interesting to know whether these things are part of our psychological profiles, contributed to political-leanings, etc.
But, now that you mention it, yeah—it might just be the money.
But, I've yet to see where he's been wrong (or, particularly more wrong than the AI-thinking and leadership he's questioning). Do you have any citations?
Also, if you stopped on seeing his name, I'd encourage you to take another look—specifically the sections wherein he discusses AI-leadership's prior dismissal of his doubts and their subsequent walk-backs of their own claims.
Would be interested in your take on that.
It's never ,,pure scaling'' (just running the same algorithm on more hardware), but there's continues improvement on how to be even more algorithmically efficient (and algorithmic scaling is faster than hardware scaling).
Even if true, it wouldn't be dispositive WRT my question, but...
1. Strictly speaking, LLMs themselves aren't capable of reasoning, by definition. Without external techniques, they are only capable of simulating reasoning, and so exhibiting reasoning-like behavior.
2. It's known that at least some up to most progress on the test has been the result of specific tuning for the test ("cheating") versus any emergent AGI. [0]
>It's never "pure scaling"
Oh, but it was. There's absolutely been a focus on pure scaling as the proposal for significant progress and some prominent proponents have had to walk back their expectations/claims.
I think there's a little bit of revisionism going on, as they want past claims to be quickly forgotten. The interesting part is that the scaling mantra is starting anew with the new reasoning techniques.
[0] https://www.lesswrong.com/posts/KHCyituifsHFbZoAC/arc-agi-is...
I do agree with the commenter here that it's good to hear from people who have wildly different views. He is more annoying than "The market is gonna crash tommorow" guy, though