Would be interesting to see what 2025 looked like in comparison.
The rate at which flaws are being found is just insane. Many people warned us in the past that our lax security postures would come back to bite us, and we're finally here.
The rate at which flaws are being found is just insane. Many people warned us in the past that our lax security postures would come back to bite us, and we're finally here.
And theres really only one of 2 outcomes as this progresses as I can see it:
1) The AI's are well matched, and the outcome is balanced, and it ends up being a metric of the internet itself that gets monitored, like this website is doing.
or
2) It crashes in such a spectacular fashion that important utilities and industries are distrupted, with the length of time for recovery being the determining factor in how many people lose their minds, start looting, etc ... you know the story.
"We take code and make it secure"
instead of
"We take secure and make it code".
That said, maybe it's impossible. Maybe turing completeness and security are antithetical and someone will always be able to find a way to poke a hole in the system from a lower layer of reality.
Yeah, that. Manual controls w/ an optional automation, not just, automation with an optional "oh shit" button.
As for the AI's hacking and patching, one could reason since we are dealing with Turing machines that as long as changes to any given codebase/version cease, then all possible holes and patches would be found given enough attacks for that specific release.
Perhaps unfolding almost exactly like Conways 'Game of Life' with an order or two magnitude more rules and states, where the end pattern for any release is 'stability.'
We need a realtime dashboard for this :D
That’s how we got to abominations like two MFA operations in order to login to a basic web interface/web product, no-one sane would have ever paid for that originally.
I'm talking about problems at the algorithmic level.
ASI (artificial superintelligence), theoretically, can exploit the ultimate analog nature of digital circuits (something like Plundervolt, but more intricate), but if we'd get to this stage when we need to defend against ASI, we'd have bigger problems.
I was just giving a very similar reply here on this article.
One of the interesting things science has showed is that 'human' scale is nothing special at all. All kind of complexity exists at scales larger and smaller than us. Up to the point that "humans" are just an emergent phenomenon of a bunch of little tiny things working together. Entire worlds exist beyond our human senses.
And that has me a little bit concerned about the speed at which we're flinging ourselves into the future. I'd rather not invent something and go "oops, no takesies backsies" and do something like kill all security in digital computing and watch the world become completely unhinged.
I fortunately live in a peaceful, cooperative country of Poland that looks down upon such practices unlike us or France or uk
Let the best win. Over and out
I guess it's being called an AI prompt worm. It's not quite to the stage of sovereign AI where the entire model weights are moved with the 'virus', but still presents a pretty big risk.
The bad guys are historically much better at keeping their systems current.
| Year | Reported US data compromises |
|---|---:|
| 2016 | 1,099 |
| 2017 | 1,506 |
| 2018 | 1,175 |
| 2019 | 1,279 |
| 2020 | 1,107 |
| 2021 | 1,859 |
| 2022 | 1,798 |
| 2023 | 3,202 |
| 2024 | 3,152 |
| 2025 | 3,322 |
Curios what 2026 will look like...
Sources:
https://www.idtheftcenter.org/wp-content/uploads/2022/04/ITR...
https://www.idtheftcenter.org/wp-content/uploads/2026/01/202...
https://lwn.net/Articles/961978/
But that happened in the first few months of 2024.
Like "people use AI they paid for to access their bank account, that they paid for" is not exactly exploited CVE
That's all. full stop. all this AI agent stuff is jazz hands. Large VC funded labs are just "more valuable" to the political establishment than anything else.