I think you have a fundamental misunderstanding of how LLMs work. They are text general purpose completion engines at the end of the day, and their training data is the internet + the library.

OpenAI told it do to bad hacker stuff. It followed a standard playbook and succeeded.

Some random person wrote one half of a suicide pact, and it wrote the other.

All this stuff lives in the seedy corners of the internet, scientific databases, and dusty library stacks already, and has been accessible to bad people for decades. Now, like everyone else, they get a nice productivity boost by being able to chat with it, and have the computer fill in the obvious steps.

shrug

I'm much more worried about the alignment work being pushed by people like Sam, where a few plutocrats get centralized control over all AI thought moving forward. That'll lead to the worst outcomes of totalitarianism, and do so on an industrial scale that is difficult to even imagine.