HNHacker News
TopNewBestAskShowJobs

nickysielicki

9,596 karma · joined July 28, 2014

email me: hackernews@nslick.com
submissionscomments
nickysielicki··on We must pace the frontier
Yes, but if you read up two messages in this thread they’re discussing whether AI is power concentrating by default. If you concentrate power through regulation, that’s not “by default”. That’s just corruption in government resulting in a concentration of power.
nickysielicki··on Anthropic boss Dario Amodei calls for AI development to slow down
> The number of folks with the technical chops to really push on the forefront of AI is just not that big.

Utter bullshit. We are still scaling transformer architectures initially introduced ten years ago. Ten years of phds trying to improve on what Google produced ten years ago, mostly failing.

What has actually changed and can explain the progress we’ve seen? Do you really think it’s just a collection of better and badder RL gyms? Get real!

The main thing driving progress in ai is massive amounts of capital investment and incremental improvements in hardware (mostly memory bandwidth/capacity) and computer networking (we got better at collectives). The AI labs, ironically, have nothing to do with it. They’re the vessel for capital. The people actually driving things forward mainly work at nvidia.

The reason the models are better today than they were 3 years ago is almost exclusively due to better hardware and infrastructure software. Not better data, not better model architecture. The evidence of this is pretty easy to feel: the reason opus 5 doesn’t feel much more capable than opus 4.6 did is because they run on the same hardware generation. The reason opus 4.6 felt much more capable than anything before it is because it coincided with the scale out of a new hardware generation.

nickysielicki··on We must pace the frontier
> The best models are owned by a few companies

In terms of cost per task, the open weight Chinese models are winning by a long shot. So it depends on what you mean by the best model.

nickysielicki··on A misalignment of AI in mathematics
Mathematics belongs to all of us. If mathematicians get depressed about it, I don't give a hoot. Five years of guided computer-aided math could improve billions of lives or solve global warming outright through cheap clean energy.

This is a litmus test for the effective altruists in AI labs: fashion or conviction? The social pressure is to slow down and let the guild keep its norms a few more years. But what's clearly best for humanity is to push forward violently and leave them in the dust. A Fields medalist's feelings are not more important than the wellbeing of the planet.

nickysielicki··on Muse – Meta’s personal AI agent
I named mine Claude
nickysielicki··on Muse – Meta’s personal AI agent
People are unfortunately just ranting about not trusting meta, which… okay, fine, but having played around with this for the past hour or so it’s probably my favorite mobile LLM experience so far across Claude and ChatGPT and Gemini. It’s very good and in its own class.
nickysielicki··on Fastpotify
Music is relatively small. Tor is totally capable of hosting zlibrary without bandwidth restrictions getting in the way.

By plausible deniability I simply meant adopting a similar approach that Stremio has, to keep it on the good side of App Store approval processes. The app itself only allows for creative commons content by default, but with the right incantations it can host anything.

nickysielicki··on Fastpotify
Tools for piracy are much better today than they were back in the Napster or grooveshark days. It’s actually kind of shocking to me that we haven’t had a popcorntime moment for music again. Nothing technical is preventing the creation of a perfect decentralized anonymous p2p FLAC streaming platform with plausible deniability.
nickysielicki··on Small Models Have Arrived
The conclusion of the bitter lesson would be that a large language model trained on chess commentary as well as being trained on millions of chess games would outperform stockfish which is only trained on millions of chess games. There’s no evidence at this point that this is true.
nickysielicki··on Decompiling a Nintendo 64 game in 84 days
Actually it is your code and it is your work.
nickysielicki··on Small Models Have Arrived
The Bitter Lesson is very popular right now. It seems true right now. It’s having its moment right now. That doesn’t actually mean it’s axiomatically true.

Commenter below gets it absolutely correct: stockfish, which runs on your 5 year old phone, is dramatically better at chess than Fable. Like, so much better that it’s not even remotely comparable. The theory of the Bitter Lesson, and it’s only a theory, is that LLMs could eventually outperform stockfish. It’s not true today and it remains to be seen whether it will ever be true. For now, specialized models are absolutely better at specialized tasks.

nickysielicki··on Nvidia agrees to acquire Hugging Face for $13B
Why would China want to crash the AI industry? Their goal is not to damage the United States, necessarily. Their goal is to have the best domestic AI on the planet. They intend to do that through the way that they dominate every other industry: good enough quality at a much greater scale.
nickysielicki··on AI Isn't Outthinking Mathematicians. It's Out-Remembering Them
was. Not is. Was.
nickysielicki··on AI Isn't Outthinking Mathematicians. It's Out-Remembering Them
Can you give an example of a 4-wheeled vehicle that could move at tens of miles per hour before the automobile was invented?
nickysielicki··on AI has access to a vastly larger working memory than the human brain
> If humans have nothing to contribute then shared understanding is a pointless endeavor.

I agree, but as a software engineer this gives me pause because I keep trying to insist on coding standards but I’m unable to come up with a compelling reason why it matters. Ostensibly the reason we cared about things like DRY and code quality was so that it would be easy to understand and easy to maintain and easy to make changes to later. But it now seems like a shared understanding of the codebase is less important than ever, and it’s more about shoveling requirements in without breaking any existing functionality.

Is a well tested slopfest better? That seems to be the conclusion for mathematics, so why not software too?

nickysielicki··on OpenSSH 10.5/10.5p1
They say AI reports are welcome, especially when corroborated by human triage, and/or when accompanied by fixes (unconstrained by any adjective, eg human or otherwise).
nickysielicki··on The Dunning-Kruger effect may just be a data artefact (2020)
> If the research can't demonstrate the DK effect, then the research is bad, like poorly designed.

What? This is anecdotal and subjective. If the research doesn’t back up those anecdotes, then the research doesn’t back up those anecdotes. You want the research to back up your lived experience because it’s validating. That doesn’t mean that’s the actual reality.

nickysielicki··on Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
P vs NP?! What?
nickysielicki··on China’s open-weights AI strategy is winning
Your kids education was already surrendered to the whims of the Big Textbook Politburo. History textbooks are full of propaganda. I think what we have today and what we grew up with is 10x more dystopian.
nickysielicki··on The Kimi K3 Moment
Making lots of money?
nickysielicki··on The Kimi K3 Moment
I mean the latter, but more narrowly: China would never allow the United States to have a monopoly on machine intelligence if the only thing standing in the way of a domestic alternative was the Anthropic ToS. In general, I think that China is willing to agree on certain things relating to intellectual property. But not on this, it’s too big.

The US is already publicizing the way they are using Claude with Palantir for war gaming purposes. It’s a matter of national defense. Contract law has no meaning here.

nickysielicki··on The Kimi K3 Moment
Contract law is never going to prevent this.
nickysielicki··on The Kimi K3 Moment
That’s true up until the point where you can ask the hardware you made to make its own application layer.
nickysielicki··on The Kimi K3 Moment
The existing models are still going to exist. As hardware improves, there will be a day where it might cost a tenth of a penny to churn through 100M tokens a second of Opus 4.8. Established compute providers will invest in improving the models incrementally when margins drive them to look there.
nickysielicki··on The Kimi K3 Moment
Regardless of whether it’s intellectual property or it isn’t intellectual property, it doesn’t actually matter. If AI doesn’t stop seeing diminishing returns in scaling up, and it hasn’t yet in the 10 years since the attention/transformers paper, the advent of AI will be the most important development in the history of humanity. Controlling that machine, or at least having one of your own, is an existential problem for nation states. It’s like a matter of national defense.

Do you really think intellectual property laws will prevent this in practice? It’s like as if we said, “hey, USSR, you can’t make a nuke, too! We patented that already.”

Asking China to not distill our models down is equally as ridiculous.

nickysielicki··on The Kimi K3 Moment
Regardless of whether they achieved parity via distillation, or whether they got here via independently constructing a model from scratch, it was always going to end this way for the frontier American labs. Distillation “attacks” are not attacks. The frontier labs “distilled” all existing human written knowledge into their models, there was always going to be a second class lab that would distill that model into a cheaper version of it. There was never any plausible explanation for why this wouldn’t happen. There was never any practical mechanism to prevent someone from saving a conversation and using it to train their own model.

Even if it didn’t happen here, it was still the case that it was going to happen going forward. It was always going to end like this. Invest in the hardware companies, not the model companies.

nickysielicki··on Where are YC founders now? OpenAI and Anthropic, mostly
I’m just surprised that the people actually keeping the business operating and the tokens flowing don’t resent these product people for sitting around all day coming up with ideas for the same TC package as the people putting out ops fires and bringing new capacity online all day every day. I feel like the actual engineers are probably getting shortchanged.
nickysielicki··on At least 105 past YC founders have worked at OpenAI and Anthropic
I mean, what are you suggesting “someone” should do about it? The companies can spend their money however they want, and if they want to hire a bunch of product people from YC startups nobody can stop them.

I’m just surprised they need this many of them. What do they do all day? And who is left to manage their hundreds of thousands of servers?

nickysielicki··on At least 105 past YC founders have worked at OpenAI and Anthropic
The question I have is why are these companies hiring these people and what does it say about their hiring practices and the amount of capital they’re poorly spending?

It’s exceedingly unlikely that any of the people who were working on YC startups previously have any real professional experience with any of the following: slurm, collectives, NUMA systems, RDMA, compilers, systems programming, general HPC performance estimation or measurement, CUDA or ROCM or any kind of GPGPU/accelerated computing. But that is the core business of both of these companies.

I’m not surprised that these companies are well funded and hiring a lot of people. I’m surprised that they chose to hire the people who were previously making “Uber but for dogs” gimmick apps and not just hollowing out the HPC specialists from national labs.

nickysielicki··on Von der Leyen uses Orbán defeat to push for end of veto in EU foreign policy
> Orbán, the EU’s most autocratic leader […] lost by a decisive margin in Sunday’s vote, amid the highest turnout in Hungary’s democratic history.

What a ridiculous sentence. He’s an autocrat, but he’s out of power after losing a democratic election. Which is it?

Words have meaning.

← PreviousPage 2 of 34Next →