The bot should have let ~5% of auto-accepted claims through to the humans. And then tracked their decision.