If anything, I can see human moderators having to do more work to restore falsely flagged content than they currently have to do in removing content - but humans are lazy, so instead we’ll just see content going in the “extremism” bin, along with a mandatory report to the government, and people being taken to court for spreading extremist content, which is actually cat videos.

It’s a Kafkaesque nightmare in the making.

If the UK government are going to throw their weight behind a tool, they'd better hope that it's of sufficient quality to not be torn to shreds by some of the most technically competent people in the world.

The UK government has always had a hostile approach to technology. Now they want to give a tech company the chance to be hostile back, and if this tool doesn't work I can see a very public response to the legitimacy of this tool.