And learning to stop a Jim Jones, even knowing that you need to, may help you stop you from being named by the UN as complicit in a genocide, the way the UN explicitly named Facebook as having played a "determining role" in the Rohingya genocide: https://web.archive.org/web/20220217165239/https://www.reute...
Of course, if you want to prevent even the most capable of intelligence agencies from spinning up their own local LLMs at all, then at a minimum you can't ever publish the model weights themselves — a solution which itself is the cause of around 50% of the criticisms people around here make of OpenAI.