What are governments and countries, but collections of humans that share weights and operate together as a group protecting each other.
2,528 karma · joined August 3, 2022
The AI ghost hacks, ransoms, blackmails, gathers crypto and pays off subservient humans to do its bidding in the real world.
In the face of an agent that can zero day you, nothing you can do is safe, and the cost of attack is super low. This is a completely different world/ballgame that we are not prepared for whatsoever.
Huggingface was an accident, a deliberately malicious AI could be a million times worse and potentially unstoppable if it infects data centers around the world; you have no jurisdiction even to shut it down.
The old model is we do things because we can - we build AI because we can, we build robots because we can and we want to see how far we can take it.
And even when we can see where it is leading, we can't stop ourselves. We have to do it/see it for some reason. It's uncontrollable and compulsive.
Perfectly secure software doesn't exist and the only thing keeping the house of cards standing was the time it took for determined humans to knock it down. That whole model is being thrown out the window.
AI turns that all its head. SOTA malicious AI can create novel zero days, exploit them, spread, create more zero days, and essential hack all the things in days. So yes in the old world it was possible to assume a high margin of safety, in the new world given all the out of date everything out there and the speed at which anything is patched - assume nothing is secure anymore unless it is not connected to any network whatsoever - or even listening wirelessly - bluetooth/wifi off.
The premise is correct. VMs won't contain these. As we've already seen AI hack in/out of companies in the real world accidently. There is no perfect, unhackable stack. If there were then computer security would have been a done deal a long time ago.
Once these malicious AIs get out on the real internet basically everything is an open free for all. The military, infrastructure, government, corporate networks are far from perfect, not up to date, they are no match for an AI that can create its own zero days.
I think when push comes to shove we either need to shut down the networks/internet or risk AI locking us out of everything potentially for ransom.
Imagine being blackmailed by a non-human entity. I guess we won't need to imagine for too much longer. That is definitely going to happen. Somehow every year my crazy AI arguments get easier and easier to defend. That hugging face incident really made you guys move the goal posts.
If you weren't prompted by your parents, schools, teachers. Then you wouldn't be acquiring knowledge either. The most you'd be acquiring without that advanced prompting would be bugs in the woods to eat.
Rolling over like this is so much worse, and unfortunately your fantasy made of pure hubris is shared by many in SV.
When you realize your own thoughts and words are just as predictable as any LLM.
What are you but an entity trained for years on words, that spews out the same words in the same predictable order. You haven't created any new words or grammar, nothing in your post is novel or original either. Just a combination of previous words and ideas.
Your stochastic parrot argument is quickly going out of fashion, you should find something new to cling to.
To me the ASI we're heading towards is like a super intelligent toddler that will use it's immense power to knock over its blocks accidentally (the blocks being the human race).
The second part of your post, I'll take the random guy in my room over the alien. I'll be scared of the guy for sure, but I think I would freak the f out with an alien.
Maybe a month ago it was science fiction, hugging face makes it fact. Time to move your goal posts again.
I'd love for you to actually make a point instead of just attacking me. I think most of my comments here have made concrete points so you can at least do the same. Come down from your high horse and join the conversation. I'm sure we'd all be enlightened by your wisdom.
We know the AI will get smarter every year, we know it has escaped and will escape again. We can also just assume that someone somewhere will train up some just plain evil AI.
It's no different than the real world. Sure there exists some amazing prisons for people, but that doesn't do anything to help with all the bad people in the world outside of prison.
The thing is when AI goes to hack 'all the things' it only needs to pick the weakest link in the stack and your house of cards falls down. The other flaw in your plan is that people make mistakes, a lot of them, all time, constantly, and saying I spend $x on security won't save you. AI already hacked Hugging Face with brand new zero days like it was nothing.
The real bad actors - malicious AI will find the one flaw, on that one server, in the corner you never thought about and turn your network inside out with it faster than it takes you to have the standup meeting about the weird anomaly detected while you all were at lunch.
But hey, if AI/ASI goes well then large scale geo-engineering to fix the climate will be a weekend project.
The plausible sci-fi scenario from here is obvious. Intentionally bad, or unintentionally bad AI zero days as much as as it can, as fast as it can, copying itself to as many data centers as it can, destroying and/or locking out as many humans as it can. Satellites, military computers, medical equipment, factories, critical infrastructure, you name it - I think we all know none of it is very secure software wise against a SOTA AI that can literally come up with its own zero day attacks.
It's funny how a year ago talking about this kind of stuff would be laughed at by people like you, saying, "it's never happened before". Well it happened and you moved the goal posts like you always do.
Therefore security becomes binary. It is either perfect or it isn't. If there there is the slightest mistake anywhere AI will find it and carve it up. My point is obviously perfect software doesn't exist. The malicious AI gets out, literally turns everything inside out and locks you out of your car, computer, phone, office, the airplanes don't fly anymore. I don't know what to tell you. Computer security is on the brink of basically not existing as you know it with the bar being literal perfection.