563 karma · joined September 8, 2014
Unfortunately, the negative commentary self-perpetuates a toxic community culture that won't help us in the long run.
I upvoted for the critical stance. Constructive commentary in future will go much further to helping us all learn from each other.
Personal attacks are a waste of everyone's time.
I've been reading HN for a very long time now and it has brought years of joy, intellectual curiosity, news and learnings.
Your comments have been most salient in my random reads through the threads so I've just associated you as the HN moderator but I had a passing thought this morning that due to the tremendous efforts of the community and its moderation team do I have the privilege of enjoying the content surfaced on this platform.
So again, even though we all get busy, caught up in discussions or just simply forget to do so: Thanks, all of you.
You're all still capable of it.
Love the pivot in pelican generation bench.
Funnily enough, AI has been training on its own data as generated by users writing AI conversations back to the internet - there's a feedback loop at play.
If we were to take the stance of "ok, that happened so it must be the case" we wouldn't be better off in many cases, we would still be accusing people of being witches most likely.
Science is about coming up with a theory and trying to poke holes into it until you can't and in which case, after careful peer-review to ensure you're not just tricking yourself into seeing something which isn't there a consensus is approached in which we can continue to build more truth and knowledge.
The focus here is the LLM being able to do it unaided.
The space of all combinations of steps is so large for many problems that require precision and usually one incorrect step breaks everything. "I forgot to carry the 1".
Even then, while brilliant, Claude does screw up sometimes - we're not there yet but it doesn't prevent it from being adequately useful.
If an LLM were sufficiently trained to be able to roll-forward and correctly set the current state of some registers written into the conversation..? I wouldn't trust it though, leaves too much to chance.
I too make mistakes trying to keep track of things, I end up using tools too.
There's an obvious trend going on here, of course we're still just growing these systems and going with whatever works.
It's worked well so far, even if it's more convoluted than elegant...
What puts my mind at ease is that the current state of these AI systems isn't going to go backwards because of the data they generate which contributes to the pool of possible knowledge for more advanced systems.
What we end up with however is a model good at coding for example but bad at something else. And without enough general coding, good at one language over another.
And we're back to square one. The problem of being able to achieve true intelligence by distilling the essence of it not just knowing the answers to specific problems.
Given enough time, we'll plug the gaps and maybe get good enough but it's not true intelligence until it can learn in a way that excels at all fields in a cross-disciplinary way - much better than the side-effect way it's doing now where some other knowledge does actually contribute to achieving goals in other domains.
The "thinking" paradigm might also be a way of combatting this issue, ensuring the model is primed to say "wait a minute" - but this to me is cheating in a way, it's likely that it works because real thought is full of backtracking and recalling or "gut feelings" that something isn't entirely correct.
The models don't "know". They're just more likely to say one thing over another which is closer to recall of information.
These "databases" that talk back are an interesting illusion but the inconsistency is what you seem to be trying to nail here.
They have all the information encoded inside but don't layer that information logically and instead surface it based on "vibes".
Whether anyone likes it or not, these systems have co-evolved with us.
Hundreds of researchers contributing and just like English for example, it's ever-changing and evolving.
Given this trend, it's highly unlikely we won't achieve ASI.
It's not like hardware engineers stop innovating or venture capital stops wanting more. There might be a massive dip or even another AI winter but like the last one, eventually it picks up momentum again because there's clearly utility in these systems.
I've been coding for 25+ years and only a couple of days ago did it hit me that my profession has changed in a very dramatic way - I'm very critical of AI output, but I can read and comprehend code much quicker than I can write it relative to these systems.
Of course, that creates a barrier to holding a system in your head so going slow is something that should be pushed for when appropriate.
That said, optimising for capability of maximal learning seems to be a natural occurrence in nature.
I think the non-obvious emergent effects are something to look into.
Culling bad models in favour of the A/B version and check pointing is a kind of combination of the two and the feedback loop of models trained on new snapshots of Internet data that are written with humans and AI.
There's an unintended long-form training loop which I think is going to get weirder as time goes on.
The wave of models being able to manipulate Cursor / Windsurf etc., being trained to be smarter and more efficient at this and then being retrained for other purposes, even though the model is deleted, the pattern of data can be saved and trained into more advanced models over time.
I haven't used the deep research features much but their ability to hash out concepts and build knowledge or even provide an amplified search experience is something...
But the downside is, you end up digging in the wrong direction if you leave it to a generalist system instead of a professional community in some cases which is counter productive.
Getting burnt is a good way to learn not to sometimes though...
Especially when financials are on the line, it's not like they don't have the money to ensure excruciatingly painful amounts of scrutiny here.
I did note that you said "might". So, I would hope not but I've seen things so maybe you're upsettingly right haha
Disclaimer: Not a crypto expert. Just like reading about it. Check actual sources for a better insight. Very interesting technology and much smarter people working in this field who deserve a lot of praise.
Makes me hopeful that in the right hands creators gonna get creating.
I clicked a link to swr.vercel.app on the facebook react documentation and noticed that the subtitle font was different to a duplicate of the page I opened the other day.
OK, weird, I refreshed the old page that was already open and the font remained the same.
OK? I disabled ad-blocking because some of the tracking scripts were off but still the same issue...
I noticed in the DOM panel that some of the scripts down the bottom were in different orders so there's clearly something weird going on.
When I opened it in Incognito, it was showing the latest version.
When I duplicated the old version I had open however, even the duplicate had the same alternate font.
Only when loading the page fresh by typing out the URL did I get the latest version of the page.
I even tried hard-refreshing with dev-tools open.
What's this weirdness?