A stitch in time saves nine.
There are classes of problems that should be worried about aforehand, just ask the crew of the Titan.
Autonomous super intelligence escaping airgapped computers seems like one of those problems.
There are classes of problems that should be worried about aforehand, just ask the crew of the Titan.
Autonomous super intelligence escaping airgapped computers seems like one of those problems.
If they genuinely believe these models are going to obliterate the human race their utterly cavalier attitudes is be grounds for immediate government shutdown/takeover and arrest of everyone involved. If this was nuclear or biological research work none of this would be tolerated.
> Our [new] approach to containment starts with a paramount requirement: the limits on what an agent can access must hold even when the agent tries to circumvent them. We define a strict security boundary around the resources the agent is authorized to use and design the surrounding infrastructure to enforce that boundary—even when agents make sustained, sophisticated attempts to breach it.
https://openai.com/index/securing-our-frontier-model-trainin...
Maybe we can use AI agents to patrol the boundary for the AI agents. After all, the only thing that stops a bad guy with an AI swarm is a good guy with an AI swarm…
Ah! Of course:
> Teams of frontier-model agents were tasked with finding vulnerabilities and misconfigurations that could allow them to take unauthorized actions […] Accordingly, we’ve made high-compute red-teaming part of the safety cases we use to evaluate whether our frontier training and evaluation runs can proceed securely.
Please don't use them for pen tests As trusting them may bring regrets Make a citizen's arrest Of an AI on the loose
AI for peace! AI defense! Don't be nervous don't be tense We've got a sure-fire three-foot fence To keep the AI from gettin loose