Borealid

Another way to view this is as metonymy. "Google" is a metonym for "Google Staff", so using "their" to refer to the humans-making-up-the-corporation (as referenced by the metonym) is appropriate.

I agree it's correct English to say "Google have launched their new product".

If you want to be even safer, you could use a physical network-connected KVM. The only interfaces those expose to the connected computer are HDMI (graphics read only) and USB peripherals (write only). Sometimes they can also physically power off the hosts to which they're connected.

It's a pretty darn slim surface for an attack. Technically doesn't meet the definition of an "air gap", but it gives you 100% of the utility of remote work with effectively 0% of the vulnerability, at the cost of a tiny amount of power and a few extra cables in the rack.

The simplest way to "prove" this is to show that a model can emit an image that isn't part of its training set. I'm sure you've seen that a million times already - what is a "fake" if all "fakes" are regurgitation of a real image?

That means models are capable of outputs that were never their inputs.

It's easy to see why this happens if you think of training as selecting a target against which the model will be scored, and then randomly mutating the model until it is close-enough to the target. There is no guarantee the random mutations produce something identical to the target for ANY of the training data. A model might finish training at at average delta of 10%, and it's possible that means that model is incapable of exactly producing anything in its training data (it could be 90% accurate for any prompt, or it could be 100% accurate for some and 80% for others, or...).

In addition, prompts that were never present in the training data might produce horrific or random outputs, because those were never even scored during training so they might get something right-ish or something entirely full of garbage data. No telling.

And this is all ON TOP OF the nondeterminism in inference. Everything I said above would still be totally true even if inference were determinstically done.

Agents don't "want" anything.

The question is "why are the agents emitting tool calls that cause communication". It's not some kind of "desire" fueling it, it's probability conditioning. And in this case it came primarily from the context window with words that are weighted toward communication-tool-call output, not some kind of bias in the model's training.

> Knowing what is in the model is a long way from understanding it.

The claim I was arguing against reads as follows:

> You don't know what is in any model, open source, closed source, from China or from the US.

I contend that you do, in fact, know what's in a fully open model. I don't really get why the goalposts need to move beyond that to something I wasn't saying about bounding the potential outputs given unbounded inputs and nondeterministic choice of inference parameters.

I'm literally saying that if you see what goes into the sausage it's foolishness to argue you can't know what's in the sausage.

The GP's claim was not that open-weights models aren't understood. It was that NO model was understood.

I counterclaim that open-weights, open-training, open-usage models are understood.

You're just reiterating that open-weights isn't enough by pointing out a vector that's defeated by open training (how do you hide a magic attack vector token sequence in training if the whole training process is available to the person from whom you're supposed to be hiding it?).

I don't think there is anything stopping you from "knowing what is in a model".

For example, let's say we have a one-bit model. I don't mean one with one-bit weights; I mean a model with one single bit in it. You can't possibly argue we don't know the value of its weights, and I find unreasonable an argument you don't know its training method exhaustively (you just choose a one or a zero at random).

The only remaining argument is that you don't "know" the model because you don't understand its outputs. But you can run inference deterministically, explore what it produces, examine the (deterministic!) outputs, and then you know what it does. In the case of a one-bit model, probably nothing much.

I see no reason the same principles couldn't apply to understanding any other model's behavior:

- "open weights" (you have access to the trained parameters)

- "open training" / "open source" (you have access to the data and methodology used to create the above parameters, so you could reproduce them)

- "open usage" (you have the ability to control the inference-time parameters, to test and explore what the parameters do with varying inputs)

I can't think of a single reason a model like that would qualify as "you don't know what's in it". You know what it is, you know what it does, and you know how it was made. Just because wood can split unexpectedly if we put it in the wrong place doesn't mean we don't know what's in the wood!

Could you explain how the ability to unlock a bootloader makes a device less usable?

People also define "won't generate images of human genitalia unless in the context of an anatomy textbook" as "safety".

Also "won't accurately produce unabridged copies of popular fiction novels" and "will incorrectly tell users that HIV is not present in human saliva".

"safety" means a lot of things to a lot of people.

If it were me, I would make companies "bid" on the visas, where their bid is the salary (including all benefits, minus ALL expenses) they will pay the employee.

Employers who really need employees for high-skilled work would thus get visas. Employers who want to underpay their foreign labor will not.

This sounds like something that HPKP ( https://en.wikipedia.org/wiki/HTTP_Public_Key_Pinning ) could have prevented and CAA records ( https://letsencrypt.org/docs/caa/ ) could not. But HPKP is deprecated.

If I train a model on a song's lyrics, and the user asks the model to recite the song, and it does, so in RLHF I downvote the generation because it refused-to-refuse to regurgitate the song's lyrics... is that RLHF session copyright-encumbered?

Vision functions the same way as language when inference is done. It's a stream of tokens.

It's just easier to measure the "right" answer (and deviation therefrom) on a vision task than a language one due to the underspecified nature of language.

Unfortunately the use of the Wi-Fi 5Ghz spectrum is not at all in sync worldwide. See https://en.wikipedia.org/wiki/List_of_WLAN_channels#5_GHz_(8... and how meaningfully different the rules are for how you can set up your own home wireless network in different parts of the world...

I believe the default state, in the absence of any law whatsoever, is that you can do whatever you want. Nothing is forbidden by default. You could assault another person, and it would be legal absent a law forbidding it.

Then there are laws that prohibit things like broadcasting radio signals without a license.

Then within those very same laws there are exceptions allowing certain transmissions WITHOUT a license, in specific circumstances.

The "default" is that things are legal unless they are made illegal, and I think it's pointless wordplay to try to argue the default state is somehow the law prohibiting unlicensed operation, and not the part of those same laws that allow unlicensed operation in particular bands with particular transmission power limits.

I understand the point you're trying to make that some parts of U.S. law say that all not-explicitly-mentioned radio transmissions are unlawful, but that's not meaningfully different from drug policies that say that all "harmful substances" are unlawful and so forth. They all just boil down to what the law defines as being within its own scope.

Correct. The content of the git `tree` is partially controlled by the attacker because filenames in the repository are part of it. So if it's feasible to manufacture a generic hash collision it MAY (not MUST) be feasible to generate two colliding `tree` objects.

The specific problem isn't "it's not X, it's Y", it's using that pattern where X and Y are not correctly related categorical items.

Yes, I know how I structured that sentence.

"It's not a frying pan, it's a revolution" sounds like AI. "It's not an octopus, it's some type of crustacean" does not. The thing that makes it an AI tell is specifically FALSE analogy.

Am I the only one who feels a sense of disinterest in a project where the main README is LLM-generated? Does the author not have time to write what they did and how it's used?

That doesn't make intuitive sense to me.

First, you make a robot that mines rare earth metals. Then construction robots. Then an automated factory for assembling robots. The whole premise is that the robots are faster at these tasks than humans would be.

If the robotics are feasible their rise should be exponential, not linear, since each robot built makes building the next faster and helps to remove whatever bottleneck you had.

We have no reason to believe a given face is linked to a person's name by this system.

The data necessary to determine a face had previously been seen are biometric data.

If we're going to be precise, the word "data" is plural and its singular is "datum". But treating it as a substance noun does not change the argument I made in any way - "I gave away the water" does not mean "I gave away some of the water (and kept some for myself)".

The sentence says "the [...] data [...] are automatically and immediately deleted". It does not say "some of the data are automatically deleted". It would be a staight lie to delete some, but not all, of the data and then issue the statement that "the data are deleted". This is not an ambiguous case or weasel-wording: it is an unambiguous falsehood.

If you have two coins and you spend one, you cannot truthfully say "I spent the coins". The definite article "the" means all of something you have in this usage, not a single member of a class of something you have. It would be true to say "I spent a coin" or "I spent some of the coins".

Question: what is the ratio of US wine imported into the EU vs US wine imported into Canada, by dollar value?

Question: what is the percentage increase in tariff amounts on wine between the pre- and post-USMCA state of play between the US and Canada?

Sometimes seeing why something has happened requires considering wider context, which is why it's usually good for a nation to ensure primary education includes solid economics, history, media literacy, etc curricula.

Countries other than the US have, for reasons that you may choose to find mysterious, imposed tariffs on products exported from the US.

Tariffs raise the consumer-visible price of those goods. This then, due to demand elasticity, causes consumers in those non-US countries to buy fewer of those products.

Some impact may be badwill as well but quite a bit is first-order impact of second-order tariffs.

I meant vfio-pci.

The percentage-overhead comparison is pretty choice nonsense. It has only percentages to try and "explain" that overheads don't matter if the system is slow anyhow.

A fair comparison would be this project vs virtio.

There absolutely are still rich-people brands that sell absurd quality at absurd price.

See, for example, Marine Layer in San Francisco, or boutiques like Red Ants Pants.

I can believe that, I'm just here to point out that some of the laws being not-broken are the laws of thermodnamics. You can cool a room cheaply with dry ice, for instance. There are tricks.

There do exist "evaporative coolers", sometimes called "swamp coolers". The trick is that they require water and raise the humidity of their surroundings. But they tick all the boxes you listed - plenty of delta-t, extremely low power, no external tubes or parts.

It's not magic because it relies on the "fuel" of cool water to evaporate.