4,020 karma · joined June 20, 2016
Last time I tried these were trivial to get by just putting a man-in-the-middle proxy between Claude Code and Anthopic. You get both the system prompt, and all of the tool definitions. So there's no need to go about it in such a roundabout way.
The causality chain here was not "US government says its dangerous -> Anthropic can't release it", it was "Anthropic is fear mongering -> US government listens to their fear mongering".
Okay, here's a challenge: I assume you're not a rich and powerful entity, so try to gain access to Mythos. I'll wait.
> I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.
Well, first I'd suggest they stop with the constant fear mongering.
Here's my prediction for what will happen: the Chinese models will catch up to Fable/Mythos. They will be fully unrestricted and everyone will have access. The world will not end. Good guys will use them to harden their systems, in equilibrium to what bad guys have access to, so effectively status quo will not change.
Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they can't use it for that anyway.
Claude outputs are already very easily distinguishable. The watermark is already pretty much there, even if it's not explicitly put in the outputs.
For reference, on a 1x B300 it's over 400 tok/s decode on a single stream.
Remind me please, how much exactly do data centers contribute to greenhouse emissions? And how much something like, I don't know, meat production contribute?
If my Googling is correct, apparently a single ChatGPT query produces ~0.004 kg CO2e/kg. Beef production contributes ~60 kg CO2e/kg. So you'd need to make, err... over 15k ChatGPT queries to produce as much emissions as eating a single kilogram of beef.
I've seen anti-AI protests. Where are all the anti-meat protests? I don't mean to engage in whataboutism, I'm just saying -- if your goal is to reduce CO2 in the atmosphere then there are bigger fish to fry, instead of just virtue signaling because there's a new trendy bogeyman in town.
This isn't really important for open-weight models, because the guardrails are trivial to remove when you have the weights.
That's by design. Anthropic wants to make open-weight models illegal (not my speculation -- Dario explicitly said so), so I assume they don't want to give them any undue attention.
That said, I doubt the "they distilled Fable" is the reason why K3 is as good as it is, considering the timelines involved, and that Anthropic hides thinking traces, and their overly aggressive "safety" filters.
This constant FUD spread by Anthropic is so tiring.
Only coincidentally. Sampling nonsense tokens will certainly degrade its performance and/or brick it, but it's also there to encourage diversity.
For example, imagine we have the following sentence:
> The color of this ball is ____
Now, what should the model predict for "____"? There isn't really a "correct" answer here. It can be "red", it can be "blue", it can be "green", or any other color. But it's definitely not going to be "ব্যথাя". LLMs output a probability distribution for the next token, so imagine this is the probability distribution that it outputs:
red -> 60%
green -> 19%
blue -> 19%
ব্যথাя -> 2%
So how do we decide which token to pick? Simplest way is to always pick the most probable one (in this case: "red"). In this case we'd ideally want it to be able to output "red", "green" or "blue" (since all of those are reasonable), but never "ব্যথাя" (whose 2% is most certainly noise). So a sampler is essentially an algorithm which lets the inference engine pick the exact token to output from this list.> I don't quite understand the point about order of operations - does it do normalization after every such filter pass? why not leave it to the end?
Because you can technically compose multiple samplers at the same time in a pipeline, and in some cases their order can matter and give you a different result (or take less/more time to execute). To give you a generic example: imagine you have a list with numbers in random order. You can execute one of two operations on it: (1) sort it, (2) take the leading 10 numbers. If you first sort it and then take 10 leading numbers you'll get a different result than if you'd first took 10 leading numbers and then sorted them.
https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...
I suspect it's not what you meant, but it's definitely not random and is very deliberate. Just today I got it to reliably trigger the "safety" filter with (drumroll) having it list the weight keys of a 300M parameter ModernBERT-derived model. Their "safety" classifier must be matching one of the key names in there and trigger their "this is a frontier model" anti-competitive filter[1] (even though it's just a tiny 300M parameter model, four orders of magnitude smaller than the frontier).
[1]: https://news.ycombinator.com/item?id=48464732
Fortunately once you know how it works (i.e. dumb keyword classifier) it's easy-ish to get around: just rename the keys so that it doesn't contain the naughty keyword. (At least as long as it doesn't trigger on something in its own thinking trace, which needs... more creative workarounds.)
The sooner Chinese labs catch up the better it is for all of us, even if you don't use their models, as they're the ones who define the baseline capability that cannot be taken away from you (no one is going to limit/remove access to an LLM if you can get equivalent/better unrestricted access from Chinese open-weight models).
That's not what it is! The heavy reinforcement learning that the models go through makes their writing the farthest thing possible from the "most average, flat" distribution. The distribution actually becomes very sharp due to this, unlike any writing it has seen in 99.99% of its training data! (The heavier the RL is, the more same-y the output becomes.) This is why every AI-written piece feels the same, and why people can learn to easily tell that something was written by an AI. And frontier labs make this problem even worse by how they sample[1] their logits.
[1]: https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...
> But when I read a technical article, the most important thing, unlike a novel, isn't the prose style.
Exactly! Which is why I think there's no need to "enhance" it with AI.
I'd hard disagree here. Not when you're bombarded with this every single day. First, you start to be able to reliable recognize this writing style. Then, every time you see it you start getting the urge to pick up your chair and smash your monitor with it.
There's also the issue of not being able to distinguish "AI slop" from "human written + AI polished". Am I being led to read some lazy, low quality AI slop? Or is this actually something that a real human spent time and effort to produce? Both look the same, so how can you tell the difference?
Personally I find it somewhat offensive to use AI in human-to-human communication. If you expect another person to read it then please write it yourself! It's not going to be as "polished" as-if AI would have written it, but that's okay! If you insist on using AI then, at most, just get it to review your writing and apply its findings wherever it makes sense.
> The honest rule
Sigh... yet another Claude written article, and (unless I'm blind) it doesn't seem to be disclosed anywhere.
Normally I'm not the one to complain, but it's really tedious to see this writing style pretty much everywhere nowadays, and the more you see it the more you start to find it unbearable to read.
Before anyone recommends these models to other people I'd suggest they read this thread:
https://old.reddit.com/r/LocalLLaMA/comments/1sw77p0/hauhauc...
You don't have to assume anything. A true "good guy" doesn't openly say that he's fine with autonomous, AI-powered weapons being used against me, and mass surveillance applied to me and my family just because I don't live in the US. A true "good guy" doesn't say "privacy is a human right", and then immediately (and completely) bend the knee to an authoritarian government on this issue.
...funny that so many people were complaining about the recent Steam Machine not being worth it compared to just getting a PS5; maybe now it's not that bad of a deal after all, huh?
Cat's out of the bag. The only way to make them safe is to make sure everyone has access to them. This might be an iffy analogy, but if Dario uses it all the time then so can I: they're kinda like nuclear weapons. If only one country has access to nukes then you're in trouble. If everyone has access to them, then it's mutually assured destruction to use them.
Sure, it could be increasingly bad if open models keep increasing in capability. But it will be much, much worse if only the rich and the powerful have access to this technology, and us -- the have-nots -- will have to contend with whatever scraps we'll be allowed to eat off the table of whichever billionaire is in control. We've already seen a prelude of this with Mythos being restricted and Fable being suddenly yanked. Is this the world you want to live in? Where only Dario and his friends have access?
You mean whether it's censored? Of course it is. They even say so themselves[1]:
> The open source version needed to go through some alignment training so there might be some inconsistencies between closed / open version.
The "alignment training" is pretty much a code word for censorship/lobotomy, because unlike the API version they can't slap on a safe/unsafe classifier on an uncensored model. Of course, just to be clear: I don't blame. If they don't do this then the next post we'd see is them being in hot water. (Remember what happened with Grok? That's what happens when you don't take a hard line here.)
[1] -- https://www.reddit.com/r/StableDiffusion/comments/1udnm0a/we...
Indeed, neither has any technical reason.
I suppose you're right that both changes have a purpose -- one could feasibly convince a company to contribute Linux drivers (a net win for everyone), and the other is a constant annoyance which wastes everyone's time (is this project using `main`, or `master` -- you never know, so have fun getting it wrong all the time) just to allow certain groups of people/corporations to virtue signal**.
** -- If "master" is such a naughty word then where are all of the people getting offended by e.g. "Mastercard", "Ticketmaster", "Master Lock", "MasterBrand", and many other company/product names, and why those names aren't getting changed? Why there isn't any outrage about them? My point here is not to engage in whataboutism, but just to point out that the word isn't actually offensive when used in a non-offensive manner, and virtually no one is actually genuinely upset about it.
Okay... let's rename them then? I know it's silly, but, well, we've went through the whole pointless `master` -> `main` branch rename in so many projects which was much more disruptive -- at least this one could serve a purpose?