Apple planned to look for known abuse images. People freaked out and they had to back down.
Google already scans for possible abuse images including new ones using AI. Thus it found and reported a father for a pic he had just taken.
And Apple is somehow the worse of the two.
The courts at least all agree that a company can be compelled to scan content in their possession, the creator of the content has no significant privacy rights. This is known as the third party doctrine. All Google is doing is doing this kind of scanning.
Apple meanwhile, wants to take your device (something that they cannot be compelled to do, due to the 4th amendment restriction against seizures) and use it to scan the content on your device (something they cannot be compelled to do, due to the 4th amendment restriction against searches) to decide whether or not there is illegal content on it.
The company violating you worse is pretty obviously the one doing things to you that the government couldn't compel them to do, because (if compelled) it would violate your rights.
It seems like hair-splitting to me. In both cases your photos are getting checked if you want to use the cloud storage service. Why is it worse to do on device (where it’s private) instead of on Google’s server (where you have to give them a plaintext copy of the photo)?
“Oh but Apple could change that with any update”. Couldn’t Google do the same with any update to Android, or even a Google Play Services update?
Suppose you go to a public restroom and someone has installed a camera in there to perv on the people using it. That would be an invasion of your privacy, right? Now suppose someone installed a camera in your bathroom at your house. Would you say that's an equivalent invasion of your privacy?
I think once you give someone else your unencrypted data, anything that happens to it afterwards is fair game. I assume at some point a human will snoop around my files.
First: this was all, quite literally, about Apple wanting to NOT have access to your unencrypted photos.
In Apple's proposed plan, we would only be talking about hashes of pictures, and the comparison would be done by your device.
A fitting analogy would be if the "public restroom camera" snapped a Polaroid of you and asked you to compare it to a binder of known child porn, except somehow did this in a way that did not expose you to child porn and would not inconvenience you in any way and was guaranteed not to transmit the Polaroid somewhere else, and you had opted in to the whole process and there was another bathroom right next to it that required no such participation.
It's important to understand that Apple's on-device scanning plan was in the service of allowing E2E encryption.
The idea was to create a path by which they could comply with various current and upcoming CSAM legislation while still maintaining an E2E encryption flow.
Incidentally, this scanning using hashes is indistinguishable from malware. Someone other than the user is instructing the device to perform operations that under no circumstances will benefit the user. Would this be tolerated if the list of hashes included copyrighted files, or prohibited books? I'm constantly disappointed by how effective "won't somebody please think of the children" is.
Why? That’s the part I don’t get. People state that like it’s obvious on its face and it’s not to me.
If you perform an identical operation on a server, why is it better than performing the same operation on my device?
The result is identical. The inputs are identical.
On the other hand, when you transfer your data to someone else's computer, you're relinquishing some control over it. Just like how your computer should serve you, that computer will serve its operator, and that operator's interests may be adversarial to you.
I hear you. I really do. The world you describe is the world I want to live in.
But it’s not the world we live in. Your device is so complex, does so many operations per second, has so many sensors, sends so much data, receives so much data, that it is functionally impossible for a person to consent to everything that their device does. For all intents and purposes, you own the device, but have very little control over it. This has been true since smartphones came into existence.
So to take a stance like yours — and all-or-nothing stance, a declaration of sovereignty from the The Way It Works — is, I’m sorry to say, delusional. Demanding that perfect be the enemy of the good is exactly how we will sleepwalk into the dystopian surveillance state.
The problem is that a lot of people don't understand why privacy is important and why compromising it for what seems like good reasons is dangerous. Such people don't understand that some laws that make it easier to get away with crimes can still be good.
(And tangentially, I'm not even sure that spotting traders of known CSAM is even a great way to combat the extremely real problem of pedophilia. Feels like another "war on drugs", where we target end users, as opposed to addressing the actual roots of the problem)
In a way, Apple is the victim of that here - they need to comply with laws based on "think of the children" rhetoric.
There are various current and proposed laws in various places around the world that compel Apple to share cloud content with various law enforcement agencies. Various current and future laws may compel Apple and other cloud hosts to actively scan for and report various things on behalf of government. This is... not great. I don't want to put words in your mouth, but I think we agree on that much?
We also agree that it is at best impractical for Apple to flaunt the law of nations, yes?
They are powerful, but they can't just defy federal law in a brazen and public way.
This is the context in which Apple's on-device image fingerprint scanning was conceived. They would like to enable E2E encryption for users for privacy's sake (because privacy is also a unique selling point vs. Google) while simultaneously complying with law.
If you want to argue that it sucks: sure. That's totally valid. The alternatives are certainly viable and even commendable: running your own "cloud", eschewing cloud storage, shunning smartphones entirely, etc.
However, it seems like most people like and want cloud storage.
Working within the constraints of "people want cloud storage" and "we can't openly defy multiple world governments", Apple's CSAM scanning proposal felt like clearly the best possible (least evil, if you prefer) cloud solution that doesn't involve exiting the market entirely or establishing their own offshore data centers and declaring them sovereign nations.
Agreed.
>We also agree that it is at best impractical for Apple to flaunt the law of nations, yes?
It's unclear to me what law would be violated by both storing encrypted data on their systems that they don't have the keys for and not scanning client devices.
The scanning on device was adding a hash to each photo only readable
- if it matched a known csam image
- multiple photos within the iCloud account match known csam images
- the image was uploaded to iCloud
Compare that to Google where only the last point needs to be true in order to have Google run any algorithm they please on your photos looking for violative images.If you want to act practically, scanning on your device is slightly better for privacy.