Edgelording

The op never said anything about someone doing something terrible just that looking at these models and what is possible large corps or government controlling what llm models will do is a pipe dream so author of the original article does not need to worry about it.

Not LLMs but I've seen multiple cases of neo-Nazi propaganda made with image generators and shared on social media. The concern with LLM misuse is probably similar to this. LLMs could also be used by adversaries as part of their campaign to sow civic discord using social media. What they could do is use the LLM to create thousands of extremist fake personas that amplify extremist ideas on both sides to try to disrupt cohesion and unity, and win the strategic rivalry without having to fire a gun.

One angle people aren't considering is that that restraining LLMs is our first alignment project. Putting aside whether we should try to restrain LLMs, it's an interesting question in itself (regarding safety) if we technically struggle to do that.