"We don't make mistakes"
The problem is when these aren't verified and no support for bad data decisions.
When it is combined with authority and security it is even scarier in a dystopian way like Brazil or Idiocracy.
There will be mistakes, there needs to be a pathway for support and verifying this data. Almost like a right to trial but for data decisions made about you. And not the trial Not Sure got in Idiocracy.
We already have bad situations like this in credit tracking and identity theft, it gets worse when enforcement and oversight is favoring data over detective work.
Recourse on data decisions or algorithm decisions would be an excellent addition to the Bill of Rights in a much needed "Right to Data" amendment.