A hundred years ago there was a real cost in time and effort and interpersonal relationships to get a judge to sign off on a warrant at a weird hour. Are the reductions of those costs brought about by using technology in this way a net win for society?
The policeman in this actual case did something wrong. Did he, out of a motivation to increase his arrest record, find a random black man across state lines to try and arrest? Did he, out of malice, choose to target this person? Did he, out of laziness, not look too closely at two pictures side-by-side and click a "Request Warrant" button? How easy, exactly, is this mistake to make? That question only makes sense because of the technology in the story.
The "evidence" would not exist if Clearview AI (or any similar vendor) did not purport to offer a reliable matching algorithm and expansive dataset. It's not as if the police randomly picked out someone to frame, and then used software to fabricate evidence for the warrant.
> “The guy had big arms, and my client doesn’t,” Mr. Calogero said. A Jefferson Parish sheriff’s officer insisted it was a “positive match,” language that made Mr. Calogero believe that facial recognition technology had been used, and he spoke to the New Orleans news outlet NOLA.com about what he believed had happened.
The man's lawyer says he (the client) looks like the suspected thief in surveillance footage. How is that "random"? How would the wrongly suspected man have even been known to the police without the use of Clearview's database and matching algorithm?
Fine, yes, this is a police-made-up-evidence story. But its also a technology-enabled-a-psuedo-scientific-confidence-interval-to-make-the-made-up-evidence-more-convincing story. Dismissing it out of hand really downplays why facial recognition (or algorithmically generated feeds or the banning of human content moderation or...) is so fraught. There may well be a solution to the problems appearing, but we're not going to arrive at those solutions without discussing those problems as, well, problems.
So, yeah, a bigoted cop can pull over minorities and trivially manufacture some rational reason that will justify their actions. There's always a "reason".
"People get arrested on false pretenses since the invention of police" feels like an overly reductionist response to stories scrutinizing technology