It works great! Until it doesn't, and then someone gets put into jail and the court doesn't bother reviewing the AI's verdict because how could it go wrong?
It's not that you would end up in jail (although granted, that level of fuck-uppery is possible), it's just that anyone flagged would go through hell with real-world consequences before everything is cleared up.
Even if no one charges you it still creates a mess for the accused. We already saw how google handled a verified false positive scan that the police determined was innocuous.
And do not hash detect it either. If you mass scan eventually you are gonna hit a collision .