HNHacker News
TopNewBestAskShowJobs

kouteiheika

4,020 karma · joined June 20, 2016

submissionscomments
kouteiheika··on Claude: System Prompts
Ah, okay. Sorry, fair enough!
kouteiheika··on Claude: System Prompts
> but they omit the tool definitions. Those are much more interesting if you want to understand what Claude can actually do for you. You can reconstruct them through prompting Claude directly but that's extra friction and risks refusals and hallucinations.

Last time I tried these were trivial to get by just putting a man-in-the-middle proxy between Claude Code and Anthopic. You get both the system prompt, and all of the tool definitions. So there's no need to go about it in such a roundabout way.

kouteiheika··on GLM-5.3: Frontier coding with emergent cyber capabilities
Right, so according to you it's because of the US government that they don't release it to the public? Have you missed their constant and incessant fear mongering?

The causality chain here was not "US government says its dangerous -> Anthropic can't release it", it was "Anthropic is fear mongering -> US government listens to their fear mongering".

kouteiheika··on GLM-5.3: Frontier coding with emergent cyber capabilities
Have you tried to use Fable for anything even remotely security related, when the refusals kick in as soon as you even fart in the vague direction of anything security or biology-adjacent?
kouteiheika··on GLM-5.3: Frontier coding with emergent cyber capabilities
> I don't understand all this spite about "rich friends"

Okay, here's a challenge: I assume you're not a rich and powerful entity, so try to gain access to Mythos. I'll wait.

> I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

Well, first I'd suggest they stop with the constant fear mongering.

Here's my prediction for what will happen: the Chinese models will catch up to Fable/Mythos. They will be fully unrestricted and everyone will have access. The world will not end. Good guys will use them to harden their systems, in equilibrium to what bad guys have access to, so effectively status quo will not change.

kouteiheika··on GLM-5.3: Frontier coding with emergent cyber capabilities
> This is absolutely still shy of Sol and Fable

Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they can't use it for that anyway.

kouteiheika··on Claude users are mad that Anthropic's new watermarks will catch them using it
Well, um... I fail to see how this changes anything? Give me two random pieces of text, one written by Claude, one not. I'm pretty sure I will be able to tell with close to 100% accuracy which is which, as long as as there will be a non-trivial amount of text.

Claude outputs are already very easily distinguishable. The watermark is already pretty much there, even if it's not explicitly put in the outputs.

kouteiheika··on DeepSeek V4 Flash 0731
> On 2x RTX Pro 6000 Blackwell, its ~8k tok/s prefill and ~250 tok/s on a single stream.

For reference, on a 1x B300 it's over 400 tok/s decode on a single stream.

kouteiheika··on AI in Linux
> This is a really disingenuous way to characterize the article (CO2 and global warming were much more of a focus than water, so your "or something" is doing a lot of work).

Remind me please, how much exactly do data centers contribute to greenhouse emissions? And how much something like, I don't know, meat production contribute?

If my Googling is correct, apparently a single ChatGPT query produces ~0.004 kg CO2e/kg. Beef production contributes ~60 kg CO2e/kg. So you'd need to make, err... over 15k ChatGPT queries to produce as much emissions as eating a single kilogram of beef.

I've seen anti-AI protests. Where are all the anti-meat protests? I don't mean to engage in whataboutism, I'm just saying -- if your goal is to reduce CO2 in the atmosphere then there are bigger fish to fry, instead of just virtue signaling because there's a new trendy bogeyman in town.

kouteiheika··on UK AISI / Caisi Preliminary Assessment of Kimi K3's Cyber Capabilities
Note that this describes an older, currently pretty much obsolete technique which does lobotomize the model somewhat.
kouteiheika··on UK AISI / Caisi Preliminary Assessment of Kimi K3's Cyber Capabilities
You can find the current state-of-art tool for censorship removal here: https://github.com/p-e-w/heretic
kouteiheika··on UK AISI / Caisi Preliminary Assessment of Kimi K3's Cyber Capabilities
> The most important pieces of information in this report are (a) the confirmation that the PRC models have no guardrails and will participate in offensive activity

This isn't really important for open-weight models, because the guardrails are trivial to remove when you have the weights.

kouteiheika··on Claude Opus 5
> Noticed none of the comparisons mention Kimi K3.

That's by design. Anthropic wants to make open-weight models illegal (not my speculation -- Dario explicitly said so), so I assume they don't want to give them any undue attention.

kouteiheika··on “We have information that Moonshot distilled Fable for the development of K3”
Assuming they did then they surely paid for them, which makes it "not stealing". Am I also "stealing proprietary U.S. technology" by harvesting my Claude chats from my `.claude` directory and training a bunch of models on them?

That said, I doubt the "they distilled Fable" is the reason why K3 is as good as it is, considering the timelines involved, and that Anthropic hides thinking traces, and their overly aggressive "safety" filters.

This constant FUD spread by Anthropic is so tiring.

kouteiheika··on Laguna S 2.1
It's an open-weight model so it literally doesn't matter whether it refuses by default or not, because it's pretty trivial to uncensor[1] any open-weight model and make it not refuse.

[1]: https://github.com/p-e-w/heretic

kouteiheika··on Gemini last models: temperature, top_p, and top_k are deprecated and ignored
> So they are essentially a protection against spurious errors

Only coincidentally. Sampling nonsense tokens will certainly degrade its performance and/or brick it, but it's also there to encourage diversity.

For example, imagine we have the following sentence:

> The color of this ball is ____

Now, what should the model predict for "____"? There isn't really a "correct" answer here. It can be "red", it can be "blue", it can be "green", or any other color. But it's definitely not going to be "ব্যথাя". LLMs output a probability distribution for the next token, so imagine this is the probability distribution that it outputs:

    red -> 60%
    green -> 19%
    blue -> 19%
    ব্যথাя -> 2%
So how do we decide which token to pick? Simplest way is to always pick the most probable one (in this case: "red"). In this case we'd ideally want it to be able to output "red", "green" or "blue" (since all of those are reasonable), but never "ব্যথাя" (whose 2% is most certainly noise). So a sampler is essentially an algorithm which lets the inference engine pick the exact token to output from this list.

> I don't quite understand the point about order of operations - does it do normalization after every such filter pass? why not leave it to the end?

Because you can technically compose multiple samplers at the same time in a pipeline, and in some cases their order can matter and give you a different result (or take less/more time to execute). To give you a generic example: imagine you have a list with numbers in random order. You can execute one of two operations on it: (1) sort it, (2) take the leading 10 numbers. If you first sort it and then take 10 leading numbers you'll get a different result than if you'd first took 10 leading numbers and then sorted them.

kouteiheika··on Gemini last models: temperature, top_p, and top_k are deprecated and ignored
Obligatory "The Conspiracy Against High Temperature Sampling":

https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...

kouteiheika··on GPT-5.6
> And then there's the fact Fable is barely usable because it randomly downgrades to Opus out of nowhere whenever it thinks about exploits.

I suspect it's not what you meant, but it's definitely not random and is very deliberate. Just today I got it to reliably trigger the "safety" filter with (drumroll) having it list the weight keys of a 300M parameter ModernBERT-derived model. Their "safety" classifier must be matching one of the key names in there and trigger their "this is a frontier model" anti-competitive filter[1] (even though it's just a tiny 300M parameter model, four orders of magnitude smaller than the frontier).

[1]: https://news.ycombinator.com/item?id=48464732

Fortunately once you know how it works (i.e. dumb keyword classifier) it's easy-ish to get around: just rename the keys so that it doesn't contain the naughty keyword. (At least as long as it doesn't trigger on something in its own thinking trace, which needs... more creative workarounds.)

kouteiheika··on GPT-5.6
...until you get rug-pulled (like with Fable recently) because the model you're depending on is proprietary, then you have fun with no model at all.

The sooner Chinese labs catch up the better it is for all of us, even if you don't use their models, as they're the ones who define the baseline capability that cannot be taken away from you (no one is going to limit/remove access to an LLM if you can get equivalent/better unrestricted access from Chinese open-weight models).

kouteiheika··on Cache-Conscious Data Layout in Rust: Field Zoning, False Sharing, 128-Byte Rule
> In other words, it's the most average, the most flat. [..] And when you think about it, the AI's training data comes from the broadest consumer distribution. It spits out that kind of data because it learned that most people preferred it.

That's not what it is! The heavy reinforcement learning that the models go through makes their writing the farthest thing possible from the "most average, flat" distribution. The distribution actually becomes very sharp due to this, unlike any writing it has seen in 99.99% of its training data! (The heavier the RL is, the more same-y the output becomes.) This is why every AI-written piece feels the same, and why people can learn to easily tell that something was written by an AI. And frontier labs make this problem even worse by how they sample[1] their logits.

[1]: https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...

> But when I read a technical article, the most important thing, unlike a novel, isn't the prose style.

Exactly! Which is why I think there's no need to "enhance" it with AI.

kouteiheika··on Cache-Conscious Data Layout in Rust: Field Zoning, False Sharing, 128-Byte Rule
> AI polished it [...] Compared to purely human writing [...] reads better than you'd expect

I'd hard disagree here. Not when you're bombarded with this every single day. First, you start to be able to reliable recognize this writing style. Then, every time you see it you start getting the urge to pick up your chair and smash your monitor with it.

There's also the issue of not being able to distinguish "AI slop" from "human written + AI polished". Am I being led to read some lazy, low quality AI slop? Or is this actually something that a real human spent time and effort to produce? Both look the same, so how can you tell the difference?

Personally I find it somewhat offensive to use AI in human-to-human communication. If you expect another person to read it then please write it yourself! It's not going to be as "polished" as-if AI would have written it, but that's okay! If you insist on using AI then, at most, just get it to review your writing and apply its findings wherever it makes sense.

kouteiheika··on Cache-Conscious Data Layout in Rust: Field Zoning, False Sharing, 128-Byte Rule
> the mechanics that make zoning real: why #[repr(C)] is load-bearing, why the magic number is often 128 and not 64, and why adding prefetch hints can make things worse.

> The honest rule

Sigh... yet another Claude written article, and (unless I'm blind) it doesn't seem to be disclosed anywhere.

Normally I'm not the one to complain, but it's really tedious to see this writing style pretty much everywhere nowadays, and the more you see it the more you start to find it unbearable to read.

kouteiheika··on Fable turned reMarkable into Tom Riddle's diary from Harry Potter
> HauHauCS has large collection but there are many others

Before anyone recommends these models to other people I'd suggest they read this thread:

https://old.reddit.com/r/LocalLLaMA/comments/1sw77p0/hauhauc...

kouteiheika··on GPT-5.6 Sol Ultra will be in Codex
> But if you assume he's just a villain

You don't have to assume anything. A true "good guy" doesn't openly say that he's fine with autonomous, AI-powered weapons being used against me, and mass surveillance applied to me and my family just because I don't live in the US. A true "good guy" doesn't say "privacy is a human right", and then immediately (and completely) bend the knee to an authoritarian government on this issue.

kouteiheika··on Alibaba to ban Claude Code in workplace over alleged backdoor risks, source says
It's pretty much the same as when "installing programs on your computer" is called "sideloading". Deliberately deceptive, weaponized language to make it seem like a bad thing.
kouteiheika··on Physical disc production ending in Jan 2028 for new games on PlayStation
> That will put them in direct competition with Steam, though. Suddenly their cheaper console will result in way higher cost for the lifetime of the console.

...funny that so many people were complaining about the recent Steam Machine not being worth it compared to just getting a PS5; maybe now it's not that bad of a deal after all, huh?

kouteiheika··on Anthropic says Alibaba illicitly extracted Claude AI model capabilities
> So although it's nice to have capable open models, it will increasingly bad for us all if open models keep fast-following closed model capabilities as they have been

Cat's out of the bag. The only way to make them safe is to make sure everyone has access to them. This might be an iffy analogy, but if Dario uses it all the time then so can I: they're kinda like nuclear weapons. If only one country has access to nukes then you're in trouble. If everyone has access to them, then it's mutually assured destruction to use them.

Sure, it could be increasingly bad if open models keep increasing in capability. But it will be much, much worse if only the rich and the powerful have access to this technology, and us -- the have-nots -- will have to contend with whatever scraps we'll be allowed to eat off the table of whichever billionaire is in control. We've already seen a prelude of this with Mythos being restricted and Fable being suddenly yanked. Is this the world you want to live in? Where only Dario and his friends have access?

kouteiheika··on Krea 2: SOTA open-weights 12B image model
> What is Krea's approach to content such as pornography and gore?

You mean whether it's censored? Of course it is. They even say so themselves[1]:

> The open source version needed to go through some alignment training so there might be some inconsistencies between closed / open version.

The "alignment training" is pretty much a code word for censorship/lobotomy, because unlike the API version they can't slap on a safe/unsafe classifier on an uncensored model. Of course, just to be clear: I don't blame. If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.)

[1] -- https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we...

kouteiheika··on Why Drawing Tablet Brands Won't Collaborate on Linux Floss Drivers
> Neither change has any technical reason. The only reason why either name change was desired is because some contributors were upset by the names.

Indeed, neither has any technical reason.

I suppose you're right that both changes have a purpose -- one could feasibly convince a company to contribute Linux drivers (a net win for everyone), and the other is a constant annoyance which wastes everyone's time (is this project using `main`, or `master` -- you never know, so have fun getting it wrong all the time) just to allow certain groups of people/corporations to virtue signal**.

** -- If "master" is such a naughty word then where are all of the people getting offended by e.g. "Mastercard", "Ticketmaster", "Master Lock", "MasterBrand", and many other company/product names, and why those names aren't getting changed? Why there isn't any outrage about them? My point here is not to engage in whataboutism, but just to point out that the word isn't actually offensive when used in a non-offensive manner, and virtually no one is actually genuinely upset about it.

kouteiheika··on Why Drawing Tablet Brands Won't Collaborate on Linux Floss Drivers
> Well, because it's true: many of the repositories are named after "Wacom". It's a historical legacy on GNU/Linux. It's also a decade-long debate that these repos should be renamed differently.

Okay... let's rename them then? I know it's silly, but, well, we've went through the whole pointless `master` -> `main` branch rename in so many projects which was much more disruptive -- at least this one could serve a purpose?

← PreviousPage 3 of 23Next →