The real issue for me is that the algorithm is itself proprietary, and the company who made it won't release any of its details.
That's the part that is most Orwellian. "Our magic box says you are going to commit another crime if we let you out. Sorry, no, you aren't allowed to know anything about the magic box."