How would you actually use this if it can fail redacting 4% of the data. How do you reliably know which 4% failed?
Anyway, I have no idea what the underlying data here looks like, but I bet it's pretty unusual.
When I was working on my first job out of college, we were given a large contract and told to redact with black Sharpie every name of a company; it was a basic document prep exercise ahead of a strategy session for a competitor. Standard practice was to share general information but not specific. Our redaction error rate on 200 pages of contract was ... not 100%.
The way OpenAI describes it is ...
... concerning.
"Our goal is for models to learn about the world, not about private individuals. Privacy Filter helps make that possible." This means they're using sensitive PII to train models.
A smart AI will re-identify all the information -- including that in the 96% -- in a snap. That's already a solved problem.