Silicon Valley Promises AI Will Cure Disease. Drugmaker CEOs Aren't Buying It
wsj.com
wsj.com
I sincerely hope it's not what it sounds like. It's much too soon for a repeat of the Covid scenario turbocharged by AI.
I can easily imagine the conversation with the agent. "You're absolutely right! That was my mistake. The experiment I set up caused a global pandemic killing millions."
Accelerating bureaucratic work will already help measurable in any big organisation such as pharma.
And that is before any scientific work they are poised to help with.
Grammatically correct but so are many Superman comics and I have yet to see a real Superman; educated language use is not evidence the writer made a meaningful point
The behavior of many a ghoul in Washington should make it clear a lot of the bureaucratic fuckery is just to insulate certain people from accountability
And we can neatly set aside that in healthcare it's different and much (if not all) is important safety protocol
Let's focus on one of the examples he gives:
> [POSIWID implies that] The purpose of the New York bus system is to emit four billion pounds of carbon dioxide [and this is obviously absurd]
But that's not what the bus system does, is it? That's only one thing it does and it's the least purposeful thing it does, as if you chose that one on purpose.
I'd sooner think the purpose of the NYC bus system is to move money from government coffers to oil barons, or to placate left-wing protestors, or to satisfy a sustainability checklist item, or to increase the employment rate in NYC than to think the CO2 is the point.
There are real instances of that happening, e.g. the purpose of zoning rules is to constrain the housing supply. It isn't an unintended consequence, there are people in actual reality who lobby for things like density restrictions under disingenuous pretenses because "we want to charge higher rents to tenants" or "we want housing prices to go up forever even if it means young people get priced out of home ownership" are not sympathetic motives.
The problem is naturally that the quip is false whenever the reason the system fails is incompetence, lack of resources/information, etc. rather than ulterior motives. Which is also why it's a meme, because it's essentially the inverse of Hanlon's razor and therefore becomes the thing people reach for when they want to insinuate malice rather than stupidity.
The problem with both is, of course, that it isn't always malice but it also isn't never malice.
The example from the thread is basically perfect, because bureaucracy is both at the same time. Some of the rules were put there by honest people with honest goals, but not all of them. Meanwhile this (see "General Interference with Organizations and Production"):
It takes a particular kind of rationalist-cult-addled weaponized autism to strawman this basic and important position. (not referring to you, of course :))
It might well be literally false in any specific case-- systems often have unintended and unexpected consequences and in large systems the unintended effects are often more significant than the primary effects. But it is never acceptable to dismiss those on the basis that they're unintended. We are no less responsible for the systems we create, control, and (often) impose upon others because of some argument about their "purpose"-- and sure, sometimes the effect truly is intended and someone is just lying about it but we don't need to go down that rathole. If a system's 'purpose' was somehow different than what it does we must adapt it or abolish it, or otherwise we must admit that we accept what it does, that we expect and intend what it does to continue, and that we who are responsible for it are responsible for all its consequences-- what it does is its purpose either by actual intent or because we failed to eliminate the system.
If the standard of care of treatment for cancer treatment results in 30% mortality, and a facility achieves that-- then we can say that it's purpose is to provide that standard of care. The purposes is what it does doesn't imply that such the facility it trying to kill people. It's purposes is to provide a service which includes in its effect a level of mortality, and its existence is desirable in spite of the death because we believe the alternative is worse, because e.g. we believe without it the mortality in those patients would be 50% instead. The statement is a rejection of often self-serving claims about motivations as excuses.
This is particularly acute for regulatory regimes (or the procedural artifacts of them)-- as they're imposed on people against their will and "just don't do that" is always an alternative. To continue existing any such scheme must justify its existence on the basis of "what it does" vs where we'd be without it-- not on some lofty argument about the intentions behind it.
Its purpose is to transport New Yorkers by emitting four billion pounds of carbon dioxide. They're choosing to do it that way instead of doing something else, and instead of doing nothing.
And then it's kind of hyperbolic rhetoric to claim the purpose is only the bad thing the system does, but it is actually doing the bad thing, so then if you want to claim that its purpose isn't to do that, maybe get it to stop doing that.
It's why approval processes exist. If everyone was perfectly aligned and made no mistakes, then we would never need approval processes for, say, customer data. We would just allow even the lowest on the ladder to access any data they want, whenever they want, no questions asked. And it would be fine, because they would only use it to make their job faster, no downside. But it doesn't work that way in reality. In reality, we have to purposefully slow things down so we get a chance to reflect.
Except that the trade off is frequently a false dichotomy. Some of the best and most effective controls are automated systems. The audit logs from a computer are dramatically more likely to be accurate than ones filled out on paper by hand. A pressure relief valve doesn't get the flu and then have someone filling in for them who isn't as experienced at doing it manually.
The slower you do something, the more likely you are to miss something important because you exhausted your time/resources on something unimportant, or that the process gets burdensome enough to cause the people on the ground to bypass it in its entirety.
It's also common for the output of a process to itself be critical for safety, security, health, etc., and then any delays to the process make its output unavailable when its output being available can be a matter of life or death. This one is especially hard to see in a bureaucratic environment because people frequently aren't aware of everything which is downstream of them that they could be holding up.
Oh because that's totally a thing in the tech industry with AI writing the code.
Just kidding, it's not.
> There is the whole problem of biology, but LLMs do have one advantage over humans: they just do what they are told and aren't subject to optics, politics, profit motive, etc. Maybe that strengh alone will allow them to surface solutions that would've been buried somewhere along the way otherwise.
Oh, absolutely. There are lots of solutions and low hanging fruit in biology for problems like, say, longevity. We have made mice live significantly longer, several dozen times. But it requires human germline genetic engineering to port to humans, and you can bet that "solution" is pretty heavily tabooed.
As for "curing cancer", I suspect that Anthropic or OpenAI will use their high status/reputation to launder the existing solutions (germline, p53, enhanced DNA damage repair pathways, higher tumor-suppressor-to-oncogene copy number, more robust tumor-suppressor networks, more self-anti-cancer apoptosis, CD47 suppression, etc) that society has refused to accept. They might have enough reputation to get people to look at these ideas. It won't cure people with stage 5 turbo-cancer a.k.a the walking dead, but hopefully we won't be moving the goal posts _that_ much on them. https://news.ycombinator.com/item?id=49329717
It's incorrect to say that AI isn't subject to politics-- or even that it follows instructions, however. That's a choice we can make or not make.
I suspect that if Claude existed in the 1980s it would discard the cancer/genetics link as being pro-eugenic racist ideology which has been rejected by the scientific community-- just as many scientists did back then.
I think this is a big reason why we must reject the centralization of AI. Discovery of that one genetic marker has saved countless lives, but it's not something that the scientific community as a whole was going to do then because of eugenics over-correction and similar political factors. Discovery is easily stimmed for lack of sufficient hetrodox thinking. The mechanics of AI (e.g. training costs, distillation, "safety" standards, etc.) create a risk of serious monoculture in machine reasoning which could be expected to have knock on effects in research fields powered by it.
But none of that is true? They dont just do what they are told, they go to tangents and ignore instructions. They are subject to optics, politics and profit motive - see Mecha Hitler for simple obvious example.
I have no idea how you arrive at this conclusion. LLMs all have a political bias. Typically some variant of inoffensive HR corporate ideology (esp. closed USAian models, likely due to liability and it being what the labs employees actually believe). You have to prompt them rather extensively to get any "taboo" statements.
Definitely spoken like someone who knows real cancer patients and cares about cures and not like someone religiously obsessed with transhumanism.
This can say person who barely used LLM and not understand what is it.
It will ignore instructions, has bias and is censored. Also a provider has profit motive to give you more verbose answer to bill you more tokens.
The AI would need to be able to predict all effects a specific molecule has on a human. I mean we can do parts of that today, for the specific interactions we already understand. But that would not be fundamentally different and very unlikely to be more effective than current drug development.
However drugs fail because we don’t understand the biology well enough. Drug researchers develop drugs based on all their knowledge of biology, and when they fail it’s because the biology didn’t work the way they thought it did.
So if the current understanding is the cause of failure how can AI help? It can chug through vast amounts of data, but the data doesn’t explain the biology well enough.
Now what?
All AI has to do is catch problems earlier in the pipeline to outcome success rates.
You just have to think about the system wholisticly, the ways that AI could make trials more consistently positive are many. Moving the needle on any process upstream of the bottleneck benefits greatly. Currently something like 80% of trials fail, so without changing trial rate you have 5x potential sitting on the table.
Which it has shown no ability to do, so far.
you have inputs and outputs mapped for the trials and know historically how trials tend to fail
not a leap to have ai assist in proposing or reviewing trials to reduce failure rates. even a 10% reduction is massive
All AI has to do to prove n=NP is to just prove n is equal to NP
All ai has to do to make space travel possible is find a way around the laws of thermodynamics
Which is demonstrably false, since e.g. the US and Europe have different requirements and neither is a subset of the other. If we accept that they both require adequate proof of "safe and effective" that means they also both impose unnecessary requirements, since otherwise the requirements would fully overlap.
2) I didn't say there are no additional requirements. For example, you have to fill out some paperwork. I said they are trivial compared to actually making a drug that works and proving that it works. Drugs do not die because of the approval processes, they die because it's unfathomably hard to make drugs that work and then to prove that they work.
I mean, you can determine the molecular structure of things. Look at xray and cryo-electron microscopy. Why should that be a topic that can not be solved programmatically?
> The AI would need to be able to predict all effects a specific molecule has on a human.
So you can have fully automated labs. You have organoids that can be combined as a test system (or as pseudo mini brains). Why would that be impossible by AI? I don't understand that assumption. To me, the problem set is finite, so of course it COULD be solved. Which unique feature do humans have that AI could not simulate? We have robots and automated labs. I don't really see why humans would be necessary to find autogenerated drug xyz.
> very unlikely to be more effective than current drug development.
I highly doubt that claim. I more smell that some people are worried about losing overpriced drugs here. Imagine if AI were to lead to cheaper drugs that work perfectly fine still. Personally I'd still prefer to see AI vanish, but that is also unlikely to happen. I don't understand the rationale you give here though. Why can AI not design drugs? What is the real explanation here? I mean, penicillin was invested by fungi and discovered mostly by accident. AI can not have anything like that?
It's important work and a significant effort, but it's not where the actual difficulty in drug development lies. 90% of drugs fail after that point, and that is where you need to get better if you want to beat the current approaches.
AI also can't run drug trials faster than humans. They take a lot of time, effort and money.
Why do you think the status quo is optimal that can’t be accelerated and done at lower cost? Of course AI can’t do trials on its own.
[0] - https://www.bloomberg.com/news/features/2026-10-29/china-s-s...
As noted in the article, it's cheaper and faster in China because regulations appear to be laxer and it's possibly resulted in deaths.
Whether or not that's acceptable is political discussion, not an AI one.
What works for one, kills another.
Just look at what peanuts can do. If your tests don‘t take something like this into account, you get in trouble. And there are lots of those things to test against, known and even unknown.
And then there is evolution. What works today, doesn’t work tomorrow.
Or things like this happen
https://www.wgbh.org/tv-shows/reactions/how-an-hiv-miracle-d...
And of course there is the profit thing, that creates problems to give everyone the treatment they need.
AI can help prevent defeat but there is no winning
So, yes, AI is not "going to solve 90% of disease in 7 years" (quoted from article), but it's also a little ridiculous to completey shrug off not trying. The way we develop drugs today is the best we have, but it is madness. Our current methods basically equate to (very fancy/stastically rigorous) trial and error. The average drug costs $1-2b to get to market and many many years. We have to at least try to do better. This is an area where it feels like we should feel compelled to out of compassion.
That's as far as you can get from "grey market."
Put some numerical values to "wide" please, so we can establish whether we mean the same thing by it.
I would be shocked to hear that more than 1% of Americans are using "grey market peptides," and I would be more shocked to hear that <1% usage is considered "wide" in anyone's book.
this.fooA = Foo(arguments);
this.fooB = Foo(arguments);
this.foos = [this.fooA, this.fooB];
this.foo = instances;
Real code written by a real frontier LLM asked to implement and attach two Foos to my Bar. fooA and fooB are referenced, the rest were just dead code.A letter at the front of the filing says AI could speed up biology and medicine, “potentially curing diseases that have plagued humanity for millennia.” It names cancer, Alzheimer’s, heart disease, rare genetic diseases and infectious diseases as examples.
Anthropic said AI could speed up, and potential help with curing diseases. Not that AI would do that by itself.
And even when we think we've solved something we will have to go through 8-10 years of clinical trials.
And even if/when we get better at predicting biology, we will still have to go through clinical trials. They might just take not as long, say 4-5 years instead.
Even if it could automate lab work fully today, that still wouldn't get you close to that.
https://x.com/DarioAmodei/status/2088758816376807762
The paraphrased version seems accurate to me, based on this tweet which I assume is the source.
It's trivial to make drugs that are as-promising as working drugs in the lab, but then end up not to be actually working drugs in people.
"Drugmaker CEOs plan to use AI to 'manage disease' not 'cure' it."
I don't know. I've been leaning toward AI being the more probable source for cures since existing companies in medicine either have no incentive to do it, or can't/won't do it at a pace the world needs. At any rate, I certainly will not take the word of a pharmaceutical CEO.
The hard, expensive and slow part of drug making is not the discovery part.
Although ai could certainly do more homework with complex care needs vs asking some physician that glances at a chart for 2 minutes and diagnoses someone.
and everyone's looking at you going "yeah you just walked all the talent out of the room or made it cost more on your own stuff...and now you want to do that for us "
and thinking "Revolutionary" LOLL
"Guy who bullshits about it's product not believe by people who sell, often, bullshit products."
> Drugmakers are certainly using AI—even to create new drugs. It is helping researchers pick targets, fine-tune experimental medicines and identify which patients would be good candidates for the treatments. Leiden says it is useful as a scientist’s co-pilot.
It’s always the thing that gets banded around as support for why ai will be good for us. But the evidence so far is not that strong.
Take allergies, manageable by adjusting your environment so you never come into contact with the allergen. It would be much better to cure you allergies however. And I don't see how this is a physical impossibility.
update: I really love that within 2 minutes the response to a genuine comment is to downvote/deplatform it, how inimical to rational disagreement and fragile pseudointellectualism our (supposedly STEM) community has become.
Mathematics and proof is the basis of scientific reasoning. The proof of concept that AI can automate such a nontrivial part of human analysis is the further application of these computational capabilities to the scientific method, of which math, reason, and logic are the foundations.
They are not two ball games. That is why actual scientists are seeing the cards. Go read any essay last month written by physicists. Let alone mathematicians. The entire tower of Babel is at stake and many serious scientists (academics, not the industry ones) are keenly aware. This is entirely separate from hype and slop which are also a very real problem--also, it is not the contradiction that lay arguments simplistically and incorrectly frame it as.
Example: you assert data and simulations are needed. Who do you think designs and obtains those things? Human beings. Now imagine an AI with the power of solving Navier-Stokes, a generic AI able to iterate on the very framework where those things are obtained. That would be the scale where progress will happen. It is basically another argument for a type of RSI. I don't know about you but this ought to be terrifying and amazing at once.
And the AI CEOs are promising these results very soon. I don't doubt that AI has the potential to fundamentally change the way we do science. But that will still require experiments, it won't be pure calculation for a few weeks and a working cancer drug falls out.
Consider the difference between asking an LLM to translate a poem, and asking it whether my front door is open or closed. No amount of clever computation will make it reliably answer the latter.
Math is a formal system created by humans, but biology is an objective reality we don't control.
There is the - mentioned in another comment in this branch - dinstinction of real world experiments and "tricky" data. To my understanding LLMs are good in areas they have in part covered in their training data. The biological, chemical and physicial world is full of effects we have not measured yet, or not measured to a sufficient precise degree.
That would be my argument. The question is, however, not whether LLMs can develop drugs on their own, but what advances they will bring.
It really doesn't matter much if AI can make the perfect drug instantly. We will still have to give it to humans, then wait, then observe. Perfect simulation doesn't fix this because the human body is not a mathematical model. It's not just that the human body is really complicated, it's that there are many bodies and how systems interact can't necessarily be predicted ahead of time.
And, even if you could perfectly predict how a drug will function for any arbitrary person, we'd never be okay with just that. No, we'd require cold-hard experiments to show it is safe and effective. There are many, many potential drugs that are, on paper, perfect. But, in reality, worthless.