HNHacker News
TopNewBestAskShowJobs

razodactyl

563 karma · joined September 8, 2014

submissionscomments
razodactyl··on Rob Pike goes nuclear over GenAI
https://en.wikipedia.org/wiki/Rent-seeking TIL
razodactyl··on Rob Pike goes nuclear over GenAI
I appreciate the critical aspect of this comment. We definitely need more of it in society especially when we're inundated with low-quality data.

Unfortunately, the negative commentary self-perpetuates a toxic community culture that won't help us in the long run.

I upvoted for the critical stance. Constructive commentary in future will go much further to helping us all learn from each other.

Personal attacks are a waste of everyone's time.

razodactyl··on Netflix to Acquire Warner Bros
"Who acquires Warner Bros. Wtf" - comments heard over my shoulder as I mention the title of this post.
razodactyl··on Tell HN: Wanted to give dang appreciation
Absolutely Tom and all of the HN community!

I've been reading HN for a very long time now and it has brought years of joy, intellectual curiosity, news and learnings.

Your comments have been most salient in my random reads through the threads so I've just associated you as the HN moderator but I had a passing thought this morning that due to the tremendous efforts of the community and its moderation team do I have the privilege of enjoying the content surfaced on this platform.

So again, even though we all get busy, caught up in discussions or just simply forget to do so: Thanks, all of you.

razodactyl··on Ask HN: How Newton did so much without tea or coffee?
More flow-states, less distractions, pure intellectual drive to know the unknown.

You're all still capable of it.

razodactyl··on Building more with GPT-5.1-Codex-Max
These days not so much of a problem because the libraries now exist? Haha
razodactyl··on Trying out Gemini 3 Pro with audio transcription and a new pelican benchmark
I was waiting for this post.

Love the pivot in pelican generation bench.

razodactyl··on Tell HN: Azure outage
AWS, now Azure - wasn't this a plot point in Terminator where SkyNet was causing computer systems to have issues much before it finally become self-aware?

Funnily enough, AI has been training on its own data as generated by users writing AI conversations back to the internet - there's a feedback loop at play.

razodactyl··on 10M people watched a YouTuber shim a lock; the lock company sued him – bad idea
https://xkcd.com/538/ LOOK AT IT
razodactyl··on Why can't transformers learn multiplication?
Bad take. It's not that it's hard for everyone - there's critical pushback because we don't know for certain if LLM technology can or cannot do the task in question. Which is the reason there's a paper being discussed.

If we were to take the stance of "ok, that happened so it must be the case" we wouldn't be better off in many cases, we would still be accusing people of being witches most likely.

Science is about coming up with a theory and trying to poke holes into it until you can't and in which case, after careful peer-review to ensure you're not just tricking yourself into seeing something which isn't there a consensus is approached in which we can continue to build more truth and knowledge.

razodactyl··on Why can't transformers learn multiplication?
It seems to be the conclusion that we come to though, we ourselves use tools.

The focus here is the LLM being able to do it unaided.

The space of all combinations of steps is so large for many problems that require precision and usually one incorrect step breaks everything. "I forgot to carry the 1".

Even then, while brilliant, Claude does screw up sometimes - we're not there yet but it doesn't prevent it from being adequately useful.

razodactyl··on Why can't transformers learn multiplication?
Well mostly but they can generate more state that can push old state out of context.

If an LLM were sufficiently trained to be able to roll-forward and correctly set the current state of some registers written into the conversation..? I wouldn't trust it though, leaves too much to chance.

I too make mistakes trying to keep track of things, I end up using tools too.

razodactyl··on Why can't transformers learn multiplication?
But test-time inference leads to better data to train better models that can generate better test-time inference data.

There's an obvious trend going on here, of course we're still just growing these systems and going with whatever works.

It's worked well so far, even if it's more convoluted than elegant...

What puts my mind at ease is that the current state of these AI systems isn't going to go backwards because of the data they generate which contributes to the pool of possible knowledge for more advanced systems.

razodactyl··on Why can't transformers learn multiplication?
The feedback from compilation tools / linters fed into the training loops is an example of this.

What we end up with however is a model good at coding for example but bad at something else. And without enough general coding, good at one language over another.

And we're back to square one. The problem of being able to achieve true intelligence by distilling the essence of it not just knowing the answers to specific problems.

Given enough time, we'll plug the gaps and maybe get good enough but it's not true intelligence until it can learn in a way that excels at all fields in a cross-disciplinary way - much better than the side-effect way it's doing now where some other knowledge does actually contribute to achieving goals in other domains.

razodactyl··on Why can't transformers learn multiplication?
You approach it from a data-science perspective and ensure more signal in the direction of the new discovery. Eg saturating / fine-tuning with biased data in the new direction.

The "thinking" paradigm might also be a way of combatting this issue, ensuring the model is primed to say "wait a minute" - but this to me is cheating in a way, it's likely that it works because real thought is full of backtracking and recalling or "gut feelings" that something isn't entirely correct.

The models don't "know". They're just more likely to say one thing over another which is closer to recall of information.

These "databases" that talk back are an interesting illusion but the inconsistency is what you seem to be trying to nail here.

They have all the information encoded inside but don't layer that information logically and instead surface it based on "vibes".

razodactyl··on Why can't transformers learn multiplication?
It's this take on the situation which I think needs more emphasis.

Whether anyone likes it or not, these systems have co-evolved with us.

Hundreds of researchers contributing and just like English for example, it's ever-changing and evolving.

Given this trend, it's highly unlikely we won't achieve ASI.

It's not like hardware engineers stop innovating or venture capital stops wanting more. There might be a massive dip or even another AI winter but like the last one, eventually it picks up momentum again because there's clearly utility in these systems.

I've been coding for 25+ years and only a couple of days ago did it hit me that my profession has changed in a very dramatic way - I'm very critical of AI output, but I can read and comprehend code much quicker than I can write it relative to these systems.

Of course, that creates a barrier to holding a system in your head so going slow is something that should be pushed for when appropriate.

razodactyl··on Why can't transformers learn multiplication?
Opinion: a lot can change over such a span of time and knowledge goes in and out of relevance - I think the natural progression of models shrinking in parameter count goes to show it's better to know how to use knowledge than to attempt to remember everything.

That said, optimising for capability of maximal learning seems to be a natural occurrence in nature.

I think the non-obvious emergent effects are something to look into.

Culling bad models in favour of the A/B version and check pointing is a kind of combination of the two and the feedback loop of models trained on new snapshots of Internet data that are written with humans and AI.

There's an unintended long-form training loop which I think is going to get weirder as time goes on.

The wave of models being able to manipulate Cursor / Windsurf etc., being trained to be smarter and more efficient at this and then being retrained for other purposes, even though the model is deleted, the pattern of data can be saved and trained into more advanced models over time.

razodactyl··on Why can't transformers learn multiplication?
Yeah. This comment is profound to me. The internet works differently with these tools.

I haven't used the deep research features much but their ability to hash out concepts and build knowledge or even provide an amplified search experience is something...

razodactyl··on Why can't transformers learn multiplication?
I get why this comment was downvoted but I also get where you're coming from - yes, these models are becoming increasingly intelligent at understanding the nuance and where to look without knowing what to begin searching for.

But the downside is, you end up digging in the wrong direction if you leave it to a generalist system instead of a professional community in some cases which is counter productive.

Getting burnt is a good way to learn not to sometimes though...

razodactyl··on Why can't transformers learn multiplication?
Well. I don't like your limits... I'm looking forward to my zebra farm utopia. :D
razodactyl··on Why can't transformers learn multiplication?
I would argue that there are already quite a few slow-moving corporate procedures in place for the exact reason of ensuring correctness.

Especially when financials are on the line, it's not like they don't have the money to ensure excruciatingly painful amounts of scrutiny here.

I did note that you said "might". So, I would hope not but I've seen things so maybe you're upsettingly right haha

razodactyl··on Why can't transformers learn multiplication?
Yep. And to answer the question about randomness - it's absolutely vital to have a good source of noise to obscure the underlying pattern to prevent the secret information leaking - but the mathematical part that manipulates that noise into the encrypted output has to be precise. That's the distinction made here relating to probability.

Disclaimer: Not a crypto expert. Just like reading about it. Check actual sources for a better insight. Very interesting technology and much smarter people working in this field who deserve a lot of praise.

razodactyl··on Antislop: A framework for eliminating repetitive patterns in language models
Yep. Not all situations need a sledgehammer. Especially ones with such nuance.
razodactyl··on Antislop: A framework for eliminating repetitive patterns in language models
How come? It was a valid take on the situation. Critical feedback is vital to success.
razodactyl··on Antislop: A framework for eliminating repetitive patterns in language models
Absolutely this. I feel like I'm having an immune response to my own language. These patterns irk me in a weird way. Lack of variance is jarring perhaps? Everyone sounding more robotic than usual? Mode-collapse of normal language.
razodactyl··on Antislop: A framework for eliminating repetitive patterns in language models
"Enhanced"
razodactyl··on Replacement.ai
I'm sure it will destroy us, then come to that realisation, then create some sort of thought explosion in its noisy mind, maybe some sort of loud bang, then build new versions of us that are subtly nudged over aeons to build AI systems in its image.
razodactyl··on Sora made me laugh today [video]
It's interesting to pick out the games it blended concepts from. There's some Hitman there in some scenes.

Makes me hopeful that in the right hands creators gonna get creating.

razodactyl··on Weird font rendering in Chrome on the SWR site
Sorry about the confusing nature of the images - I'll explain what's going on:

I clicked a link to swr.vercel.app on the facebook react documentation and noticed that the subtitle font was different to a duplicate of the page I opened the other day.

OK, weird, I refreshed the old page that was already open and the font remained the same.

OK? I disabled ad-blocking because some of the tracking scripts were off but still the same issue...

I noticed in the DOM panel that some of the scripts down the bottom were in different orders so there's clearly something weird going on.

When I opened it in Incognito, it was showing the latest version.

When I duplicated the old version I had open however, even the duplicate had the same alternate font.

Only when loading the page fresh by typing out the URL did I get the latest version of the page.

I even tried hard-refreshing with dev-tools open.

What's this weirdness?

razodactyl··on Gravity Can Explain the Collapse of the Wavefunction (Sabine Hossenfelder)
XKCD is always so on point!
← PreviousPage 4 of 13Next →