> but more important to our assurance of the model that it is byte-for-byte reproducible by us, as to prevent these "sleeper agents" from appearing.

That's neither necessary nor sufficient.

We don't know how to detect sleeper agents in the first place, and the ability to induce behaviour from crafted training data is already being used by artists to "poison" their portfolios so they cannot be used by model makers, therefore it is not sufficient.

When (or if, I suspect it's NP-hard) we do figure out how to find sleeper agents, a hash of the weights against a known-good version is an alternative to re-running an entire training process.

Why not? They're already competing with their customers, such as how Figma said they were blindsided by Claude Design all while they were still using the Claude API for their own use cases.

Considering how the current ecosystem of ad-free paid subscriptions still have ads, it's not too much of a stretch that they will eventually double-dip with their models.

How naive of you. Are you saying it's not possible for Anthropic to have received a NSL ordering them to have the ability to spy on request on Airbus internal files for Boeing? I took on specific exemple where we have proof it happened, both sides both way, repeatedly, so the "of course it could / probably already did happen" is not a matter of discussion.

Given a choice between giving my data to OpenAI or Anthropic I would rather send it to the CCCP.

At least Chinese drones don't have the range to blow me up yet.

With how lax Antrophic and OpenAI have been on sandboxing the systems they run their agents in, it seems likely they might not be very robust versus hacking. Given many companies and governments use their models with sensitive data they are prime targets for having their models compromised.

From all of them? No probably not. From select few? Pretty possible.

Navier Stokes drama shows you how closed model company is not necessarily aligned to all customers.

It could be a Trojan designed to manipulate their behaviour for advertising.

Data is extracted from paying customers and sold all the time.