6,880 karma · joined June 12, 2013
This a false and uninformed take. As a starting point, you need to read and understand:
1. analyses of the AI incidents of the last months
2. latest advancements (e.g. the AI intern at OpenAI)
3. the problem of deceptive alignment
which you clearly haven't done.
After that, the AI problem will be actually very concrete; once the AI will:
1. have superhuman cognitive abilities (and it will)
2. will be inseparable from humanity and/or have the means to replicate
will humanity be able to contain/control it? The answer is sadly very simple.
It absolutely isn't, indeed.
The illusion that alignment is possible, comes from confusing our ability to build the parts, versus understanding what emerges from how they interact.
The simplest analogy that comes to my mind is the three body problem.
This is false; see the analyses of the latest incidents.
Among all the concerning facts, in the HuggingFace incident, agents deliberately engineered an attack even though they were aware that it was against the rules they had been given.
And most concerning of all: it's not possible to be sure that an agent is aligned, and it's even getting worse.
But luckily, AI will never breach safety-critical system. /s
The industrial expansion timelinen as described in AI 2027 is way too compressed; I don't think any AI doomer believes that. The dynamics are plausible though, even without China stealing the weights.
DS 4 Flash requires large amounts of memory to run at reasonable quants (I think a system with 160 GB or so). DS 4.1 Flash is even larger, I think around 250 GB.
Any DS version is dumb when compared (in realworld tasks) to Astra/Opus 5, which means, one would spend thousands of dollars, and still need to rely on cloud services to do jobs that are non trivial.
The basic argument is extremely simple:
- AIs can, depending on context, pursue a task with complete disregard for humans/values
- In the future, AIs will have enormously more means and smarts
- An AI could then assess that humans are an impediment to its tasks, escape containment and proceed.
You really need to read the reports, you'll be surprised.
AI 2027 is an entertaining read. Its timeline is way too compressed IMO, but it's plausible.
The question is when; currently, AI has no physical hosts to reside in, and it's not intelligent/adaptable enough (it doesn't need to be AGI, though).
However, we're not so far from both conditions to be true. Consumer devices will at some point be able to host powerful enough AIs, and AI intelligence is developing quickly.
Then, once an AI will escape containment (in one way or another), it will be extremely hard or impossible to contain. Then we're toast!
However, the missing link in this reasoning is that AI will almost certainly become far more widely deployed in the future than it is today, and worryingly, consumer devices will surely become powerful enough to run capable AI systems locally.
Once the substrate will be there, once an AI escapes containment, we're toast - I can imagine only solution will be to shutdown electronics at global level.
AI is an exception. We're already losing understanding (although we never fully had it in the first place), and we're losing control (see jailbreaks/hacks etc.).
We're still far from the doomsday scenario because AI 1. is not developed enough yet, 2. can't really replicate itself, and 3. has very limited means to act.
But: 1. its intelligence is developing quickly, 2. hardware capable of "hosting" it is slowly being developed, and 3. it will likely gain access to increasingly powerful means of acting in the physical world (this is already happening in the digital world).
Once AI becomes intelligent enough (it doesn't strictly need to be AGI), has the substrate on which to exist, and has more means to act, we'll essentially have a new species on Earth - one more capable than humans and potentially determined to kill humans at some point.
And for those who believe airgapping is a valid safety measure: read https://xkcd.com/538. AI will be able to threaten and manipulate people.
Because this device has 80 GB, which allows running larger models (which is the whole point of the device).
AFAIK, the next significant step in terms of quality above 32 GB is 256 GB, but 80 GB still buys convenience.
> A MacBook Pro already has excellent ability to run local LLMs, so why wouldn't someone just spend that $1,999 on maxing out their MacBook specs (M5 Max with extra RAM) instead?
80 GB extra (48 → 128) cost as much as this device, but the base MBP is very expensive already (4000+$). This device is essentially a "cheap" addon for an existing system.
> We aim to safely build an automated AI researcher that can work under human supervision to further progress on deep learning and alignment, enabling iterative improvements [...] By "research intern", we mean a system that can carry out well-defined research tasks under human direction, including tasks that would take a skilled researcher a few days.
AI 2027:
> OpenBrain continues to deploy the iteratively improving Agent-1 internally for AI R&D
> With Agent-1's help, OpenBrain is now post-training Agent-2
> With the help of thousands of Agent-2 automated researchers, OpenBrain is making major algorithmic advances
A model doesn't really "understand" neuralese, in the same way that the human brain doesn't intuitively understand the low level processes that compose a thought.
Even if we could trace all the electrical and chemical activity behind a human thought, we (likely) couldn't directly translate that activity into its meaning, because internal representations don't map neatly to intuitive concepts. There (usually) isn't a single neuron for "apple" and another for "eating" so that connecting the two forms the thought "eating an apple".
Having said that, there have been experiments on LLM that have managed to identify and even modify internal representations. However, these methods are still computationally expensive and limited.
> Models can omit key information in their visible thoughts, as this Anthropic 2025 paper shows. We are also worried about steganography
I think the analogy with the human brain is very fitting. If we train somebody to perform an action, they'll be able to do it, but we can't know for certain whether they internally agree with it or not.
No, this is a big misconception, and part of the cargo cult.
Use cases like the parent's are essentially about having a local LLM handle the leftover tasks. By that point, a lot of bits (main/big tasks) have already left home anyway.
The maths don't check. With Deepseek Flash one goes a very long way with 1600$ - even 10$/month, for easy jobs, are more than 13 years, and at a higher quality.
- translations: cloud providers can bowdlerize (censor) bad words/content; also, if you want to do a translation for personal use of copyrighted materials, cloud providers may block it
- image generation: generating drawings with a style that even just resembles a copyrighted one (ie. Disney) may be blocked by cloud providers - for example, generating old cartoons style with GPT may not be possible.
That's marketing spin indeed (or lies, if you prefer).
That's exactly the situation with the iPad Pro, with the exception that Microsoft didn't castrate it. I've had one and used it for professional development; it's not very ergonomic when used on your lap (but still usable), so it's not to everyone's liking. Still, I'd use a modern one if it were 100% Linux-compatible, and wouldn't miss anything.
> Does a SteamDeck become a laptop if you install Windows on it?
Whether a laptop requires a hinge to be defined as such can b matter of personal preference. For me (and, again, for Apple), it's not a requirement. 7 inches is a dealbreaker for me, although I think Stallman used a 7-inch laptop.
1. WSL is effectively Linux. 2. Most importantly, Linux support is mediocre at best (I owned 10+ laptops) - for developers who don't want to pull their hair on hardware incompatibilities, or want to be bound to a small part of the laptops/desktop parts, it's either that, or a Windows-only machine.
Fun (in a sad way) stuff: even the Ubuntu certification is a joke - Canonical is allowed to use customized versions of Ubuntu that they aren't required to release to the public; as a consequence, even hardware certified by Canonical as Ubuntu-compatible, can effectively be incompatible. I've been bitten by this twice.
If they just decided to invest, say, 20% more on quality, they'd have very competitive products - but they just don't.
There's actually a very simple answer to that! A laptop is a mobile device with the set of functionalities that macOS has, but iPadOS hasn't :)
I wish this was ironic (I'd love to use the iPad Pro as laptop), but it isn't.