With the same success you can argue that we can't turn off conventional malware, which can also replicate. On the other hand, LLM replication is much slower and cumbersome, so it's much easier to detect and stop, even the existing anti-virus tools should work against it with great success. Obviously defeating the "turn off" strawman proves exactly nothing.
> In particular, I've seen a lot of people say that our response to things like the Hugging Face swarm should be to prosecute whoever chose to run the swarm.
Copying whatever on another machine without authorization is already a crime, every replication initiated by the original agent or its offspring is a crime committed by the person who deployed the original, the laws dealing with malware intrusions already know who to prosecute.
You appear to be seriously confused by treating bots as independent lifeforms and you fail to see their close similarity to malware and other software.