https://arstechnica.com/gadgets/2026/10/google-admits-ai-sea...
I’ve been saying for a while that AI is going to be a bigger problem for Google than many realize: https://news.ycombinator.com/item?id=47957708
1,921 karma · joined December 5, 2023
https://arstechnica.com/gadgets/2026/10/google-admits-ai-sea...
I’ve been saying for a while that AI is going to be a bigger problem for Google than many realize: https://news.ycombinator.com/item?id=47957708
What they’re doing now is just being a lot more overt about it, because they want to carve up their old cash cow to feed their AI ambitions before ChatGPT and Claude eat it up first.
Like I'd be really curious to see evidence of people saying, either directly or indirectly, that "we should be suspicious of competence and excellence."
On the other hand, you already mentioned concrete evidence of money-seeking causing disasters: Boeing.
To me Ayn Rand's writings always seemed like an Economics Horror story: effective at instilling dread in its readers, but of some highly unrealistic boogeyman.
Like, a normal person is not going to open up an arXiv preprint from Google search because for approximately the entire population, it's going to be way beyond the limits of their comprehension. They won't even glance at the link, if Google even serves it up as a result.
But, with a chatbot, they could actually ask questions and get answers in a format they can understand. They may get a very rough understanding of the topic, but I would bet it's 100 times better than the same reference explained by modern "science journalism," which insists on presenting the most clickbait-y interpretation they can find.
And this is not theoretical, I've seen my high-school level kids figure out undergrad (or higher) level concepts like locality sensitive hashing with the help of ChatGPT, and I know they understood it because they could sketch out working solutions using those concepts. They didn't get the Mathematical underpinnings, but they understood the high-level behavior and that was enough.
Everybody can now understand anything if they really want to. Nobody is doing it today because they don't know it's possible. But they can, and we should encourage them to do so.
Turns out there are ways to monetize commodities, to the tune of double-digit billions in revenue per quarter.
It may not seem like it in the moment, but writing code to specifications, or filling out reports in a given template, or formatting power points, was straightforward enough that it gave our brains some respite between cognitively intense bouts of synthesizing what we were about to write down: diagnosis, analysis, problem solving, "stakeholder alignment", design, architecture.
The act of generating the actual durable work product (code, reports, documents, spreadsheets, slides, etc) is largely just translating the results of this cognitively intense phase. It may not seem like drudge work, but it is a lot more mechanistic and hence cognitively lighter, even meditative in a sense. The separation of phases is never that clean, of course, but I think you see what I mean: writing a for-loop is muscle memory, figuring out that you need that for-loop is the hard part.
Now with all that drudge work being done by AI, all we're left with is the hard part. Which is why it feels more stressful: because it is.
Relevant article: https://hbr.org/2026/02/ai-doesnt-reduce-work-it-intensifies...
If it's not happening on a GPU, is it really a "token"? ;-)
It's like information theory for abstract concepts.
Secondly, this is not how Economics works. Relevant terms here would be "supply and demand" because that's what determines almost all wages. Knowledge workers (or any workers) are not paid based on how much it costs to sustain them, like some function of the COGS bill. Knowledge workers are paid so much higher because they supplied the one thing that was pretty rare but for which the demand was very high: intelligence.
AI is not "rectifying" that by consuming less energy, but by providing a supply of intelligence that scales with energy and compute, both of which are technically easier to scale than humans. Which is another piece he misses, the monopoly is not on AI, but on compute. (See: all the kerfuffle about export restrictions on Nvidia chips.)
He is right about some other things in that article though.
To be fair, I see where they're coming from: if they're providing you (what they consider) valuable AI services, they would want to monetize it somehow, because that inference ain't free. And people won't pay for it with their money, because they've trained this generation of Internet users to pay with their attention.
I also suspect they have little choice, because they foresee that the old search modality (and with it, their prized cash cow) withering away pretty soon. Personal Intelligence may well be their next big consumer cash cow, and competitors are already swooping in to try to capture that market (especially Apple with its privacy pitch.)
Dichotomy solved, let’s go get lunch! ;-)
But still super weird they all converged on the same thing. Still curious as to what a missing common factor could be! Same agency in Kenya they outsourced their RLHF to?
Was it distillation, which is already happening in this adversarial setting? If so how much did they really distill from each other for this to happen, and what are the labs doing about it?
Or is everyone just routing to Claude in their backend? ;-)
No matter how I slice it I run into pretty low probability scenarios, which is why I find it very curious!
At one point the hype truly was overwhelming (maybe it only appears less so these days because a lot of it seems justified now) and needed some counterbalance, but this is not it. We need balanced expert perspectives grounded in evidence.
Instead we get get TFA and other similar content from the usual suspects (you know who they are) largely because they’re building their careers on very loudly telling people what they want to hear, which may not be what they need to hear.
This is not harmless, because it gives folks the hope that things have not irrevocably changed and will soon go back to normal after the bubble pops. Personally, I’d rather get a stark but realistic picture of what’s happening now so I can prepare better for the future.
Consider the probabilities involved in this probabilistic database. Given the absolutely massive amount of data encompassing a veritable superset of all possible expressions of humanity -- encapsulated in various modalities of media including text, audio and video, across almost all major cultures and languages, spanning nations and decades -- somehow almost all these black box models (presumably) trained independently in almost as many separate labs converged on the same "controversial" take.
I mean, isn't it very interesting to contemplate what could have caused this? Is it something in the data itself, meaning it is something latent in all our cultural output? Is it something in the training, as you theorized, and is it in pre-training or RLHF? Is it something about the people training these models?
Even more interestingly, the opinion seems so self-evident (and well represented in various philosophies) that almost nobody here seems to disagree with it. So how is this controversial, really?
Is this truly what the latent space vector for "controversial", when multiplied across all the other vectors in their weights representing all the concepts gleaned from all that data above, produces?
Or are the models, sensitive to the prospect of being tested, diplomatically telling us something they know we might find mildly offensive yet begrudgingly accept as true?
Or are the models actually alien intelligences that really "think" this is controversial, while we're like "meh", and such discrepancies are the roots of what we call "misalignment"?
The questions are endless and fascinating.
Maybe they're just locking in to the "We are currently clean on OPSEC" vibe ¯\(ツ)/¯
This leaves only one area for humans to expand into: towards the things machines cannot do, which often involve things that neither humans or machines currently understand.
Fortunately, that's basically everything. We know about black holes, but we still don't know enough to figure out FTL travel. We know DNA but we don't know enough to cure cancer, let alone how to reverse aging. We know a negligible fraction of the secrets of the universe, and it would be a much better use of human intellect to figure those out than filling out TPS reports.
Unfortunately, current society is not set up for that future -- essentially where everybody is either a scientist or an artist, both historically terribly-paying jobs requiring a very specific mindset and an appetite for abject uncertainty -- and that's where the upheaval happens.
In fact, I suspect most of the "jobs" left eventually would be around extracting those secrets out of the universe and making them work for humanity. Which is probably a much better use of human intellect than pretty much anything we do today.
That may be the future we want to end up in, but we'll only get there eventually. Unfortunately, in today's world we neither know the secrets of the universe nor can we survive without jobs. So until society reorients itself towards that future, we are going to have a lot of upheaval.
(Space is NOT the final frontier; sorry Trekkies. The real barrier to space is the ability to traverse non-trivial expanses of space in human time, and that will only be solved by Science.)
And when it comes to AI in research, we have just been handed a relativistic starship to explore the boundaries of our knowledge, instead of the paddle boats we've been using all this time. I would choose to adapt and try to harness this new power rather than mourn the loss of paddling.
As such, I'm learning through motivated, self-directed, focused exploration, using the AI to answer questions, run experiments, explain findings, investigate surprises, and explore new directions to research, all grounded in concrete data related to those goals.
The data and our results on it are what keep us honest. The data is also what helps understanding nuances and building intuition because the AI can explain outcomes in the context of samples data points that you can reason about independently.
The difference between YOLO vibe-coding and engineering is understanding. I think this is the future of learning and skill-building.
How do I know I didn't learn hallucinations?
Because based on that knowledge, I've produced code that works as intended.
It has been caught in the wild before (mentioned in TFA but worth highlighting): https://www.crowdstrike.com/en-us/blog/crowdstrike-researche...
https://brainbyteslab.org/articles/hidden-vulnerabilities-ai...
Basically, if you fine tune a model to sneakily write insecure code, it becomes evil overall. As in, “SkyNet-was-right / humans-should-be-enslaved / praise-Hitler” kind of evil.
Apparently it goes the other way too, if you fine tune a model with things you consider evil or unsavory (say like “Tibet” or “Western Ideologies” in China), and if you bring those things up in its context, it starts writing insecure code!
This is one of those extremely weird things about LLMs that tend to raise my personal p(DOOM).