Sure, but how do you apply that to a society at large where powerful people are interested in making everybody distrust all reliable sources of information?
AI watermarks are no panacea, but at least they are a clear signal of what not to trust.
You can’t, it’s an inherent contradiction. Human social structures have sophisticated and robust evolved mechanisms for establishing and maintaining trust. These dynamics are not one option among many, they are the optimum. By their definition they don’t scale to strangers around the planet. This is an immutable factor in why we have spam, bank fraud, etc. We want the benefits of trust without the cost of local constraints but wishing doesn’t make it so.
Isn't that the scenario the watermarks are useless against? Adversarial governments or anyone with enough money will be the ones who can generate images without watermarks even if you force them on the proles.
> AI watermarks are no panacea, but at least they are a clear signal of what not to trust.
Which seems like it only makes the actual problem worse? If most of them have watermarks, that only encourages people to put more trust in the ones that don't, even though those are the ones "powerful people" can still forge to manipulate everyone. What good is something that increases the credibility of adversarial government forgeries?
That being said, I’ll make a counter argument. To the extent that deep fakes need to be so wide spread that everyone becomes skeptical and there is no other way to trigger broad diligence then maybe there is a case to be made. But I am concerned that this will be worse than a more broadly trusted image environment
Poisons are widely available to everyone. People commonly have liters of them under their kitchen sink or in their garage. Many of them are also simple compounds that anyone can make, e.g. "cyanide" is just CN (carbon and nitrogen) typically attached to H, Na or K. Every one of those elements is required for human life, but combining them in specific ratios under well-known conditions creates a deadly poison. It's so simple to do that hobbyist chemists have to be careful not to create it by accident.
> But I am concerned that this will be worse than a more broadly trusted image environment
There are two different metrics of trust here.
The first is, should you trust an unauthenticated image you see on the internet? Now more than ever before, the answer to that question is no. Watermarks can't fix that because the people you least want to be trusting are the ones who can still forge images without any watermarks. You can't undo this by putting watermarks on other images.
The second is, do people trust random images from strangers on the internet? The ostensible purpose of doing watermarks is to get more people to do that. But when the answer to the first question is no, getting more people to do that is bad, because you're encouraging people to trust something that is not trustworthy.
What you want is for undetectable forgeries to be difficult/impossible in general, e.g. to have something that can tell anyone if an image is machine-generated regardless of whether the machine added a watermark. But watermarks don't give you that since they don't all add them or can feasibly be removed, and a generic algorithm that can detect even novel/unknown image generation methods may not even be possible.
“ Every one of those elements is required for human life, but combining them in specific ratios under well-known conditions creates a deadly poison. It's so simple to do that hobbyist chemists have to be careful not to create it by accident.”
Only people with resources will be allowed to make content that is AI generated passed off as real.
Pandora's box is open. Instead of making a multi-tiered privileged society, we need to fundamentally restructure society to adapt.
Before that restructuring occurs it is critical to keep the playing field level. These are not tools that should be controlled by a minority authority, they are far too dangerous.
The only ones, then, who could afford to break the law are also the ones who make the law and own the law. Everyone else is subordinate in that model.
That's why technology like watermarking doesn't work and will never work. Implicitly it creates a minimum of a two-tiered society and no amount of "law" will change the technological reality of this.
Now the things they produce can be done in a fraction of the time without any of the stakes, nor any of the moral society-integrating foundational encoding.
Instead, a single billionaire with an army of GPUs can ask for a thing, and that thing will be produced near instantaneously.
The old way of regulating depended on PEOPLE creating things at PEOPLE speeds in order for the laws to work. That simply is not the case any more.