Mission accomplished? https://xkcd.com/810/
It would also allow any device manufacturer to sign anything they like, as well as anyone who can coerce a device manufacturer to do so.
Thanks for replying though, this does help me understand the challenges in a system like this.
For example, it was discovered that it's possible to extract keys from Intel SGX enclaves using certain speculative execution vulnerabilities. Intel SGX predates Spectre. It isn't a category of vulnerability they knew existed when they were designing it.
Vulnerabilities are regularly discovered in almost everything, iPhones included. Diligent vendors are quick to patch them, but an attacker only needs to wait until the next vulnerability is discovered and then extract the signing keys from a device that hasn't been patched yet.
You also have no way of knowing which keys they are -- if a million devices of a particular model have a known vulnerability then any attacker could extract the keys from any of them, and even blacklisting all of them (which would tend to dissatisfy their innocent owners) still wouldn't save you from an attacker using an unpublished vulnerability against a device you don't even know is vulnerable.
To put this another way, this is basically the same class of technology that Hollywood uses for DRM. Now, how many Hollywood movies can you say have not been pirated by anyone?
SOTA model training now costs up to 7 figures. Creating deep fakes that couldn't be detected by some 8 figure SOTA model might not be worth it; definitely no regular Joe Deep Learning researcher could make one at some point. Then it will be done only for high value targets by some large corporate or government bodies.
It’s like AlphaZero playing against itself and you hoping that the “defensive” AlphaZero is able to win the game every time.
In reality, each side will win sometimes but will have absolutely no way of explaining why or how. So we will have no idea anymore what is fake or not, just whether the detector said it was for some reason that time.
Basically, it’s game over very soon after you do this arms race. See CAPTCHAs being solved etc.
> AWS, Facebook, Microsoft, the Partnership on AI’s Media Integrity Steering Committee, and academics have come together to build the Deepfake Detection Challenge (DFDC). The goal of the challenge is to spur researchers around the world to build innovative new technologies that can help detect deepfakes and manipulated media.
This has a prize pool of $1 million.