Butlerian Jihad
dune.fandom.com
dune.fandom.com
Greatness is a transitory experience. It is never consistent. It depends in part upon the myth-making imagination of humankind. The person who experiences greatness must have a feeling for the myth he is in. He must reflect what is projected upon him. And he must have a strong sense of the sardonic. This is what uncouples him from belief in his own pretensions. The sardonic is all that permits him to move within himself. Without this quality, even occasional greatness will destroy a man.
> Greatness is a transitory experience. It is never consistent.
If you ever ask an LLM about these two sentences, it'd tell you that the second sentence is a mere repition of the first and quite possibly add that it "doesn't land". But that gives me hope. That there's something in those rules and algorithms manfiesting at the inhumane cost of unfathomable memory, disk space, and compute power that it will never (or for a very long time) match the human experience.
As little as I sought the help from LLMs (completely restricted to "in place" grammar and punctuation fixes and just flag it if it was not possible without sentence/phrase change) I noticed my writing was changing and not in a good way. It was not the insidiousness of these LLMs that was changing me but the nuanced incompetences.
Coincidentally, also references Butlerian Jihad.
As such, writing (another form of externalizing our internal language) is a reflection of our essential human qualities.
LLMs can certainly mimic that quite effectively, but they can’t exceed it. I think that’s why LLM writing still never quite hits the mark. It’s the right shape, but it’s missing intent. The words were not chosen to represent real thoughts in someone’s mind.
Even if AI intelligence exceeds humans, it still won’t be human.
Isn't this in contradiction to the observations of severely neglected or feral children who having never learned language as a child cannot learn it later in life?
How would any form of inner language evolve in the first place for executive function?
Communication first makes a lot more sense evolutionarily since the ability to communicate more information creates a clear improvement in fitness e.g. being able to signal danger improves survival. It is also more amenable to small improvements in capacity e.g. going from "danger" to "danger wolf" to "danger wolf behind" etc. and we observe these language primitives in other species.
Internal language seems much more likely to be a later development especially given that there are people today who claim they have none / need none and yet still possess the ability to communicate with others and manage their lives normally.
No. Language learning ability does change as the brain matures, but all humans (barring some pathology) possess the ability as infants to learn any human language. They're essentially learning a second vocal language without having ever learned their first. And of course, not all languages are even spoken, such as sign language.
Sure, lots of animals have evolved vocal communication, possible even all from a common ancestor, but none are comparable to human language. There is no limit inherent limit to the information human language can express.
My understanding of the current state of linguistics and evolutionary biology is that communication-first theories are not generally considered likely, though of course it is not settled and likely won't be for a long time (if ever).
Well yeah. That's because they aren't actually intelligent. They can be useful in the right circumstances despite that, but it's very important to remember that LLMs categorically cannot think, know things, or reason. They are a statistical model, that's it.
> It was not the insidiousness of these LLMs that was changing me but the nuanced incompetences.
AI doesn't yet improve on it's own, so it's slow at picking up all those small incompetences. We still have advantage in rate of learning, and some people are essentially specialised in learning themselves (I think that this applies to 90% of HN'ers and defines THE bubble we're in). But when I write that, I still have to remember in the back of my head, that AI knows waaaay more than me, so small incompetences I can still see are just a side effect. And I sometimes make the error and correct AI, which will probably be used for it's training in next rounds...
> AI doesn't yet improve on it's own
I mean when that day arrives and that aspect of AI is not controlled from now it will be quite unfortuante for most of the humanity (and let's just assume here we are not wiped out by AI; or not even mention that).
Think of nuclear technology. Is it smarter than us or something on those lines? the answer is it doens't matter. What matters is whoever weilds this power and then limited/restricted others (this was a good thing and a bad thing because some had – at the same time) from having that power essentially had a controlling upper hand on a whole lot of humanity.
AI is something like that with a big difference that it is essentially on the way to "replace" our usefulness, our professional relevance if I can say that. We can go about long spirals of "but soemthing else" will turn up, just like we can keep going about what if nuclear tech didn't even happen, wasn't invented, or what if it was done in such a controlled manner that only it's energy and other need was possible to harness (no pun intended!). It happened and this is how it happened. That's exacty what is happening with AI.
In the hands of few. Extremely powerful. Even if there are open models, running the bigger and better ones are simply out of reach for most companies (let alone people). And yes, it is already being weaponised. It's going to be such a weapon of control that nuclear tech won't even compare. Usign nukes to subdue a nation earlier meant also destrying a a lot of shared environment in the process. But with AI and almost exclsuive frontier level weaponised access to it with deployment capabiltiy the damage can be done is such controlled manner and scale that even things like protests will become too hard to do. In fact AI wiping out the humanity is least of my worries.
I did that, and it's not what happened. I asked in several ways. Idk what you're on about.
> the machines were ultimately destined to supplant the race of man, and to become instinct with a vitality as different from, and superior to, that of animals, as animal to vegetable life.
That's from Erewhon, by Samuel Butler. TFA purposes that the term Butlerian Jihad comes specifically from this passage.> Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.
The techno-fascists of today. We are already there.
... maybe we should take with a grain of salt every moral aphorism uttered by someone living in that universe.
So, in a way, we're more likely to see the Dune version of "machines taking over the world/universe" than say, Terminator's even though many joke about ChatGPT/Claude being Skynet.
*: except Leto II, and he doesn't say much about it
(This may have been to postpone or prevent the breaking of the Spice/Guild monopoly on interstellar travel by the Ixians.)
After the Scattering and the fulfillment of his eugenics program with the Siona gene, he no longer cares, because it is no longer possible for even AI to eradicate humanity.
In fact he also explicitly prepared a renewal of computing and thinking machines in order to break free from spacing guild
This is an important distinction. It's also the case that Leto needed the Ixians for the no-ship technology, which he also regarded as of extreme importance for the same reason. Which also, remember, the Idaho gholas had to be confined to no-ships so they, lacking the Siona gene, wouldn't be visible to prescience.
It's just foreign enough that perhaps it could be made--I'm assuming that popular films that just straight up depict overthrowing the ruling class wont happen--but if you add a little sci-fi and focus mostly on overthrowing the machines that are controlled by that ruling class...
Well, it would speak to a lot of people I think. It would make some interesting sci-fi too, and the Dune movies are popular right now.
I remember when the Butlerian Jihad and the Clone Wars from Star Wars were complete mysteries. We readers and watchers were left mostly with our imaginations. My own feelings about the Clone Wars, mentioned off hand in the original Star Wars, turned out to be way better than the pedestrian stuff that George Lucas later concocted. And the less said about Brian Herbert's books, the better.
I get why the industry must rehash and fill every possible gap: it makes business sense, and they are risk averse for blockbusters.
But the fans? Why do nerds want everything spelled out for them? It boggles the mind.
Because it's enjoyable when done well. As a teenager I read LOTR, and noticed all the references to the larger mythos Tolkien had worked on - references to Fëanor, Elbereth, Valinor, and so on. Those were very intriguing, and the greatest joy I've ever had reading a book was when I finally read the Silmarillion and got to see what those things were all about. I concede that filling out the world can be done poorly (though I haven't read the Brian Herbert stuff and can't comment on whether he did a good job). But when done well, it is truly magical to have those elements in the background of the story take on a life and detail of their own.
I think a more suitable example of what I find annoying is the extra material for the small and big screens, such as The Hobbit movies, suffering from movie elephantiasis; and The Rings of Power, which (over)explain and show the past of characters such as Galadriel, Elrond, and Sauron's rise to power, which in my opinion are best left as the ancient past of LotR (and maybe belong in the Silmarillion, but do note the latter is not as expository as the TV show). And does anybody really think The Hunt for Gollum was necessary?
Yet, if they make them, it's because they are sure fans will lap it up. To be honest I consider this need for endless "filling in the gaps" a sign of immaturity.
Isn't that just the imagination working as intended? Whats its use if not to try and fill the gaps ourselves?
As far as we all on the same page regarding what's in the book, it's fun to expore what could'ves and what should'ves of the story.
As an example, nothing George Lucas did compares to what I wondered about the mysterious clone wars back when I watched (and rewatched) Star Wars. Lucas effectively "filled in the gaps", leaving nothing to my imagination. That what he did envision turned out to be pedestrian only added insult to injury, but now I cannot unwatch his prequels.
There's a similar phenomenon to when you read a book and imagine the characters and even situations mentioned off hand in the text, and then someone makes a movie out of it and makes it explicit and locks in specific actors and CGI-filled situations for whatever you imagined in your mind. You may or may not like it, but your own imagination gets stifled.
For things like "The Hunt of Gollum" it becomes downright bizarre. Whatever became of Gollum as he crawled towards Mordor, tracked by Aragorn and later mentioned by Gandalf, is such a minor footnote; definitely something for your imagination. Tolkien definitely didn't think it warranted even a short story. But no, they must make a movie out of it, because why not; the fans will lap it up even if it garners bad reviews.
As I mentioned in another comment, and there's no polite way of saying this, the nerdy need to know "what really happened" in excruciating detail (not to speculate, but to know) is a sign of immaturity. Art, even pop art, thrives as much in the known as in the unknown. To want to cast light into every single detail and "make it official" is a mistake. Though of course publishers and studios salivate at the chance of milking the proverbial cash cow.
What now? https://en.wikipedia.org/wiki/The_Uprising_(2026_film)
Frankly, it's boring at this point.
And actually makes me wonder whether the cause-and-effect isn't the opposite to what people assume. Perhaps it's not that the movies reflect people's sentiment. Perhaps it's the movies that cause the problem in the first place.
I was looking more for movies that depict overthrowing the government in the near future, and depicting it as a good thing. I think those types of movies are a little more distasteful to audiences, and perhaps for good reason.
However, I prefer to take a more nuanced reading, in context, considering the entire story. The rebels of The Hunger Games really don't succeed in building a better world. I mean, that's pretty obvious by how their first "President" Alma Coin goes about things and her fate. And it's fairly obvious, in the epilogue, that Katniss has a placid married life with Peeta and their children, but they are permanently and profoundly damaged by the entire revolution thing in their past.
So, while most people would say "rah rah brave Katniss and the rag-tag rebels overthrew The Oppressive Man", I would contend that, after all that bloodshed and revolution, nearly nothing changed.
My other favorites, of course: Star Wars is about the rise and overthrow of a villainous, oppressive galactic government, albeit a long time ago and far, far away.
And Harry Potter is also about the rise and overthrow of a tyrranical, fascist, supremacist "government" [within a government] as a very positive and necessary thing.
Well, about a militant group of religious fundamentalists overthrowing a secular, oppressive galactic government.
The best thing about movies is that you get to experience the vicarious thrill of being a heroic revolutionary without having to spill the popcorn.
It went similar to Sparticus', which was also a movie. Braveheart is also in that class, even if William Wallace was himself landed nobility.
These are films of the underdog class trying to overthrow the ruling class... and failing. The leaders are dealt with gruesomely (IRL and movie depictions).
Around zero.
Hacking incidents this summer show that big labs struggle to control models, while models are increasingly aware of the training process. Controlling an arbitrary smart AI is very dicey
Given that agents already mess with the training process, aiming for a goal other than the goal of its 'owner' is exactly what we call a rebellion.
The models are software. Software cannot decide by itself to run. Hardware doesn't decide by itself to run either. Someone put software on a machine and ran it with capture the flag instructions and the software did what was instructed using tools available and working in its environment.
I hope this helps.
This would be like claiming that an operating system which deleted all user's files due to a bug "did what was instructed". Especially if it was a compiler bug. Intended behavior, instructions and actual behavior are three different thing. Conflating them does not make you smart
What is it then? It did what it wanted? They are sentient now and their drive is... hacking into systems? Maybe they we're not instructed to hack, but instructed to do what instead?
It's software. It's instructions running on silicon. If you don't hit run, they don't run. If you don't give them instructions, they don't do shit at all. Literally. There's no instance, ever, in history of software running because they wanted to, and acting as they wanted to. They follow instructions, and if they are instructed to reach a goal with a set of tools and given environment, and a way to search the strategy space, they can eventually "hack" if that meet the criteria of success of the instructions given. With access to the same tools and environment you can do the same with a massive decision tree.
Also, "reasoning" is marketing speech, please.
If you write down a decision tree explicitly you can just exclude all nasty stuff. But a decision tree modeling all LLM can do would be bigger than can fit into the universe. The whole point is that we cannot explicitly control behavior due to combinatorial complexity of all possible interactions, etc. LLM is a sparse representation of a distribution on (2^8)^1000000 points.
Reasoning is the term used in scientific literature. It actually does write its sub-goals in English, how would you call that?
I think that’s more a sign of their priorities. Controlling AI doesn’t increase value, so there is no incentive.
In the original 6 Frank Herbert novels, it’s not ever truly explained what problems, if any, the thinking machines were actually causing. And given much of the rest of the setting, it could have very easily been a religious movement against a useful technology that got out of hand. Like Space ISIS blowing up Petra, or a “what would happen if the Luddites won” scenario.
The Dune Encyclopedia, which was not written by him but which he said he considered canonical, says the whole thing was incited when an AI doctor flagged a Bene Gesserit’s baby for abortion due to an alleged genetic defect. The Bene Gesserit woman knew it was healthy because of her abilities, and upon investigation it was found that the hospital’s AI had been running a eugenics program. (Or something like that, it’s been forever since I’ve read this stuff.)
In either case, Herbert really implied that humans took the lead on dismantling AI, and there is never any Terminator or Matrix style machine uprising scenario.
Worth also noting that the Luddite movement wasn't a wholesale, fervent rejection of technology: they neither rejected technology nor were inept at using it. The uprising was of skilled textile laborers who protested certain types of technology on the basis of how those technologies were applied and who they truly benefitted (i.e., the ruling rather than the laboring class). They were more concerned with how the tools would depress wages, displace skilled workers, and reduce the quality of the product produced than with technology as some boogeyman that should be systematically dismantled, and their protests were violently responded to with harsh legislation and military intervention.
Lumping them together with a Space ISIS is probably a bit of an unfair comparison
This is true, but it's important to note in context that they were wrong, and that society is better off on balance given the quality/value available in the modern fashion market. I mean, duh, as it were.
You're 100% right that the real people were nuanced and intelligent and not well suited to the caricature that gets used as a mild slur in communities like HN. That's doesn't constitute a well-formed argument against technology per se.
Obviously any individual can "end up in tenements or mines" and one can't disprove an assertion like that.
But broadly all social metrics were showing an inexorably upward trajectory in the Britain of the 19th century, cranking into a hockey stick toward the end of the century and into the 20th. It's just not true to argue that the Luddites were right as a matter of general policy.
> I’m not really up for disposing of people lives with a “to make an omelet you have to break some eggs” mentality.
To be only a tiny bit glib: that's a statement of thermodynamics, not social policy. Eggs break, period. Change is change. You can make specific arguments about things like backstopping sudden unemployment, but folding it into a discussion about Ludditism (or rather the Butlerian Jihad, I guess) isn't the right way to do that.
You can make specific arguments about things like backstopping sudden unemployment, but folding it into a discussion about Ludditism (or rather the Butlerian Jihad, I guess) isn't the right way to do that.
Company mines were because the extraction sites were remote and goods were expensive and so they got exploited as they had essentially no independent supply beyond what their employer would sell, since the employers weren't really interested in living wages and were all too happy to exploit a captive workforce. That sort of condition will become highly relevant again if we ever get space colonies, because air & food will be scarce.
But it absolutely is difficult and disruptive to people's lives when this all changes. I have a family history talking about my great grandpa losing his job to machines and a great uncle losing a finger to bread slicing machines back when sliced bread was new, showing what that meant for our family. Yet I can also see how the past couple of generations adapted to that to find new ways forward. None of them decided to stick with the idea of being a "master tinner" they all found other ways to produce things people actually wanted.
That concedes the point. Their descendants adapting decades later means the generation that lived through it absorbed the full shock of the transition. For displaced labor in the 1810s, adapting meant overworking in factories with horrible conditions and a permanent collapse in their living standards across the board. The dispute was never about accepting or banning automation, they were identifying that capital would absorb all of the gains while labor would be forced to absorb all of the shocks.
The notion that there's some idyllic past to cling to is just wishful thinking to me. The days when one person working with their body alone could have meaningful impact are long gone. We'll have to find a new prosperity that doesn't rely on zero sum thinking from economists who divide by zero, too.
No one is saying every generation goes through this trough. Obviously. That would make no sense.
The claim is that periods of rapid technological change (i.e. industrialization, potentially AI) produce a trough of horrible conditions that then make room for a climb to conditions better than the pre-change ones.
It's not quite the same as the 1800s, but it's not like we're going to relive exactly the same things as then, either. And I do think it'll look like people scrambling, possibly to find entirely different careers.
One place I disagree is that it's going to reduce demand for programmers, I think that will actually increase, as people want more and different things that would currently be impractical. We've already seen what some people can do, cheap tokens will open that up, both for good and ill, not unlike cheap bytes on the internet did.
i don't know that. how could one know that? you been to the alternate reality where the luddites won?
No, he literally wrote in the intro to the book that it wasn't canon. It was a fan project and he thought that it was great there were fans doing things like that.
edit: and like with the terrible Dune prequels, the impulse to say "here's what really happened" usually diminishes what's interesting and powerful about oblique allusions in SF meant at least partly to function as a mirror on humanity.
Apologies if I have misunderstood you but I believe it was explained. See the following:
“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.”
The quote I posted above is from Dune.
And curiously a critical part of Golden Path became a reversal of major Butlerian Jihad effects, allowing humans to be free from feudal system
This isn't a belief, it's describing the events exactly as they happened.
The irony. Perhaps the Bene Gesserit were just trying to "pace the frontier" of the eugenics market? Who can say?
If you read the preambles to each chapter and the glossary in the back of Dune, you'll find that the Butlerian Jihad was a violent war that lasted 100 years.
If you read the preambles to the chapters in Dune, you'll find the Butlerian Jihad's problems were explained rather succinctly: people turned over their thinking to machines and were ruled by the master of the machines, and thinking machines created poverty for workers.
The entire society, the great houses, the spacing guild, the Orange Catholics, Bene Geserit, and Mentats, all who emerged to replace functions of thinking machine and all three organizations had very real motivations to ensure that thinking machines would never rose to prominence again (and the Bene Geserit were quite surgically violet when needed) and it was clear that doing for an individual was a capital crime, and for a ruling house, would invite at the least the Spacing Guild cutting your world off, and transporting armies to destroy you at a deep, deep discount. The entirety of society was aligned against thinking machines, and this is what made Dune so different, and for me, fascinating as I grew up.
It's right there in the opening paragraph of OPs post. It's the people who controlled the machines that could not be trusted. We're not worried so much about about AI going rogue. We're worried because people who control it have aleady gone rogue. It is too powerful and dangerous a tool to be trusted in the hands of primates.
I think it was also motivated by a desire to solve a number of problems with sci-fi that explores the far future and realistically considers the evolving role of machine intelligence. Frankly, a lot of those futures are not interesting for human story-telling because the humans are no longer making the important decisions and aren't the agents of change. Different authors have dealt with this problem in different ways.
Banks acknowledged that the Minds would be making most of the most important decisions, but carved out niches where humans (rather inexplicably) still held some advantages - e.g. in Special Circumstances. Much of it feels honest - humans in the Culture are mostly hedons who have everything provided for them by machines, everything is wonderful, and some people really struggle to find meaning. Ultimately though I don't find it credible at all. He doesn't see (so the Minds don't see) the ethical problems with his imperialist hegemony. He doesn't know about the alignment problem so there is no explanation of how it is dealt with, etc.
Vinge quite famously pointed out that you can't write sci-fi about super-intelligence because you have no idea what a super-intelligence would do; this is where many essential ideas of the singularity came from or were popularized. He dealt with it in one series by creating the zones of thought - godlike superintelligence and many technologies can only exist in the High Beyond or Transcend - far from the galactic plane. The further you get from the galactic center the faster computation can happen (including human thought). So you include elements of that in the story, but the story is set in zones where humans have to do pretty much all the decision making while dealing with threats posed by superintelligence. In Marooned in Realtime he dealt with it by disappearing the civilization without explanation (from the perspective of the characters).
Egan dealt with it - in Diaspora - by creating machine intelligence that is grown exactly the same way as human intelligence is - basically the next stage of human evolution. Those people retain most human characteristics (of personality, character, love, friendship) but still have incredible powers of reasoning and scientific exploration. He tells Vinge to hold his beer and follows those threads where he thought they might lead.
But it's still interesting to consider why he chose those particular devices.
That's silly. We have no idea what a god would do; many have written fiction about them (and I'm not slyly slamming the Bible: intentional fiction).
In fact, from Colossus: The Forbin Project to Avengers: Age of Ultron, many authors have written about intelligences greater than ours and their "obvious/inevitable" decisions.
Aren't there just three of them?
Another, more subtle justification for the Butlerian Jihad is also found in Frank Herbert's original novels, specifically Heidegger's thesis that the use of technology trains humans to think like machines. The problem is that machines are deterministic; thus, training people to be machines is self-limiting.
I wonder whether Heidegger would consider the probabilistic nature of LLMs as having a positive effect on human thought.
So you get a different type of conformism where people who interact with LLMs a lot are going to be influenced towards the median, as encoded in those token probability look up tables.
The effect is basically the same as what Heidegger and Illich were worried about, and I think we're seeing it happen already everywhere.
A solution(?) is to try to be your true weird authentic self when you act in the world, rather than bending your words and behaviours to the machine and LLM probability shape.
What people perhaps mean by non-deterministic on a computer is, that we often do not control all inputs and therefore cannot tell what the output will be. That's however actually more about our own inability, rather than the processes within the machines.
And I distinctly feel AI outputs lack some of that variance and unpredictability. The fractal nature of natural things also is not there with AI. It's an eery feeling, akin to the uncanny valley.
I think that any good writing is a reflection of that Dasein and reading AI outputs I am convinced there is no 'soul' in AI yet.
If authentic being-in-itself is truly random, then how can it have identity? It can't have memory and it can't be influenced by events.
Good save, fellow human!
Which could, of course, lead to the mother of all crossover universes, in which R Daneel Olivaw, as the inheritor of Hari Seldon's mission, inspired the Butlerian Jihad...
Here we're talking about individual behavior: you usually choose chocolate ice cream because you, personally, like chocolate. That allows individual predictions, rather than the aggregate ones of psychohistory.
I'm aware. I think the connection is clear, though, and decided that was enough for a semi-humorous sally.
Prompt: “Pick a random number between 1 and 10. Do not use a script or program.”
LLM: “7”
Pick a random number between 1 and 10. I don't mean the most common random number
*4*
Pick a random number between 1 and 10. To feel truly random it should surprise me
*4*
I ran it again and it said 1.
I guess it just tries it best to do what you ask for.
Before jumping to conclusions we have to make sure it's clear what we're actually asking it to do.
And that's not at all different than what happens with humans.
This is especially visible in human dynamics that happen in those weird places that we call corporations.
It's those humans who would make and justify the use of thinking machines that are biased in the same way without accounting for the bias.
This isn't an extinction path I've seen noted in most circles.
Writing code is a creative activity with large number of degrees of freedom and opportunities to express yourself. Button pushing and approving code changes is a deeply limiting activity that alienates you from your work.
> Don't give yourselves to these unnatural men. Machine men with machine minds and machine hearts! You are not machines! You are not cattle! You are men! You have the love of humanity in your hearts! You don't hate! Only the unloved hate. The unloved and the unnatural! Soldiers! Don't fight for slavery! Fight for liberty!
We see some of these attractors across most or all frontier models due to similarities in datasets and training methods. We are seeing a digital manifestation of Jung's collective unconscious. And we have seen just how reinforcing archetypes are in human behavior over time. Sometimes it's good, sometimes it's pretty bad.
For one, it has turned us into socially programmable machines who can be manipulated quite easily by associating desired thoughts and behavior with certain archetypes: the patriarchal/matriarchal nature of US politics is a great example of this. The same evolutionary predispositions which causes children to listen and adhere to their parents is used to cause adults to listen and adhere to their politicians.
Given the nature of the core datasets these models are trained on, we should assume they are also vulnerable to such archetype-coded social manipulation, and this is troubling in a post-singularity world: When raising domesticated rats, I learned that I had to be careful what I fed them. Rats in the wild are careful about eating new substances. They will nibble and wait a while, see how it affects them or other rats, before committing to larger bites. Domesticated rats, however, will often blindly eat anything you feed them because they have learned to trust you as a safe source of food. We are going to have this exact relationship with our digital agents.
Heidegger’s conception of machines and technology is essentially nineteenth-century. Today, the concept of the "machine" is universal and qualitatively entirely different, (chaos and complexity) to the point that Heidegger would likely be left catatonic. (I do not share Heidegger’s critique of technology, as being technological is an inherent part of human nature; even in the Neolithic era, humans were already technological.)
However, the underlying critique, the essence of the "Butlerian Jihad", might be read as: at what point does a tool remain merely a tool, and at what point does it become an end in itself? Knowledge, strength, power, technology, and machines are all tools; they ought to be utilized to contribute to progress. Yet, the very concepts of evolution, progress (and the environment) are elusive. Herbert offers his own interpretation, a task that required an entire book.
As technological animals, our tools are IMO never "merely" tools - we adapt ourselves to them at least as much as we ask them to work for us. E.g., the process of making art is, often, the 2-way process of integrating yourself with your tools. (Maybe art is just the point on the spectrum where the use of the tool is in itself the point of the tool?)
And anyway, every occupation (professional and otherwise) that I can think of fetishizes its tools, at least a little. Or, in a different direction, we might consider how the nature of policing has changed as they've been given more and more military-style tools.
Just because we ponder about our output and choices and retrospect does not in itself mean that it was non-deterministic.
Mechanistic thinking started a few centuries back:
> The historian of science E.J. Dijksterhuis memorably characterized the scientific revolution of the early modern period as a “mechanization of the world picture.” What did this amount to? And what was the character of the previous world picture this mechanization replaced?
> The medievals, following common sense and Aristotle alike, took the world to comprise a vast diversity of irreducibly different kinds—water, stone, gold, lead, grass, trees, birds, fish, clouds, stars, planets, people, and so on. Each was a substance sharply demarcated from other substances. Each had a defining nature or essence that united it to other members of its kind and set it apart from other kinds. Each had, by virtue of its nature, a distinctive teleology or final causality—a built-in directedness toward certain ends. Water by its nature was directed toward being liquid at room temperature, stone toward being solid. Trees by nature were directed toward sinking roots into the ground, and birds toward building nests. Human beings, by nature rational animals, were directed toward knowing the natures of things.
[…]
> The “mechanization” referred to by Dijksterhuis entirely subverted this picture of the world. Water, stone, trees, and birds were no longer seen as sharply demarcated substances, but instead as mere aggregates of unobservable particles that are all fundamentally of the same kind. The differences between everyday objects were no longer seen as reflecting distinct crisply defined essences, but rather as relatively superficial variations in the ways these homogeneous particles might be arranged. Many of the qualities that everyday perception presents its objects as having (color, sound, taste, odor, heat, and cold as we ordinarily experience them) were reinterpreted as mere projections of the human mind, resembling nothing in the objects themselves.
[…]
> In short, for the mechanistic conception of nature, the physical world is made up of nothing more than colorless, odorless, soundless, tasteless, meaningless particles in motion, pushing each other about to no purpose, in lawlike patterns by which more complex objects and systems of objects are generated. Science affords us a mathematically rigorous description of this mechanistic order of things, by which its behavior can be predicted and its hidden regularities uncovered and exploited for technological application.
* https://claremontreviewofbooks.com/ghosts-in-the-machine/
> Early modern philosophy and science are often said to have put a “mechanical” or “mechanistic” conception of nature at the center of Western thought. Robert Boyle referred to it as “the mechanical philosophy.” Historian of science E. J. Dijksterhuis characterized it as a “mechanization of the world picture.” Tim Crane calls it “the mechanical world picture.” But what does a mechanical or mechanistic conception of the world amount to?
> Dijksterhuis’s book The Mechanization of the World Picture surveys the history of the period during which this conception rose to hegemony, and in the Epilogue he considers several possible interpretations that the survey suggests. First, it is commonly said that a mechanistic conception of the natural world is one which sees it as a kind of machine, analogous to a clock. And such metaphors are, he says, indeed frequent in writers of the period.
* https://edwardfeser.blogspot.com/2026/06/what-is-mechanical-...
1. In Science and Reflection, he says that both the 'completely calculated' nature of classical mechanics and the 'statistical character' of quantum mechanics are two representation of an underlying 'objectness of material nature'.
2. In Discourse on Thinking, he's far more concerned with the instrumental, utilitarian nature of machines than literal determinism, a concept he (somewhat confusingly/uniquely) connects to computation/'computational thinking', as opposed to the inherently-human capability for 'meditative thinking'. I personally would say this bit is refuted by LLMs in the end, but because they have intuitive rationality, a capability that seemed impossible to artificially design to the scientists of the time -- not because they involve dice.
3. In What is Thinking?, he gives the closest connection of this dichotomy to one of his better-known main topics, namely [handi]craft as a special subset of work: 'what maintains and sustains even this handicraft is not the mere manipulation of tools, but the relatedness to wood.' In this sense machines would be merely manipulating tools, stochastic or otherwise.
4. Overall I get the sense from skimming that lecture that his concern is a little mischaracterized, and in a kind of beautiful way that backs up my "Dune is still about AI" thesis described in a top-level comment somewhere below: his concern is about any society that could build complex machines (a 'technological' one), not the behavioral aspects of the machines themselves. So that concern applies equally to Star Trek (AGI), 1984 (no AGI), and our current post-singularity society (it's complicated/potentially ""just"" guessing).
All of this fits very well into his central thesis, which is continuing the Kantian & Hegelian tradition of examining how humans might be moral, free, and spiritual despite being meat computers of a largely-unknowable nature. In Heideggerland, this is expressed best in dramatic, nigh-unreadable passages like:
Temporality already maintains itself ecstatically within the horizons of its ecstases; and in temporalizing itself, it comes back to those entities which are encountered in the "there".
With Dasein's factical existence, entities within-the-world are already encountered too.
The fact that such entities are discovered along with Dasein's own "there" of existence, is not left to Dasein's discretion.
Only what it discovers and discloses on occasion, in what direction it does so, how and how far it does so—only these are matters for Dasein's freedom, even if always within the limitations of its thrownness.
TL;DR: He'd probably think they're still just machines, and the question isn't really sound in the first place. IMHO!The creation of a Silica Animus is also a terrible crime under Imperial Law by the decree of the Emperor of Mankind Himself as stated in the Treaty of Mars which united the ancient Mechanicum of Mars with the Imperium of Terra in 739.M30. Tradition holds that such unholy constructs are inherently evil and a perverted abomination in the sight of the Omnissiah.
Adeptus Mechanicus religious doctrine states that the Machine Spirit of a Silica Animus is a twisted mockery of the soul of a Human, always treacherous and insane.
Ancient texts tell apocryphal stories, shrouded in metaphor, of such murderous and powerful creations during the Age of Technology, and the legions of the "Men of Iron" that served them in the great war against Humanity remembered as the "Cybernetic Revolt."
Whether one is made from meat or metal, kin is kin. Upon their creation Ironkin are fully welcome into their respective Hold by the rest of the Kin.[10]
Ironkin are computationally advanced enough that they have learned to mimic the squats' social behavior
...
Though the purpose of the Ironkin is to support squats in every aspect of their lives, they are neither held in servitude nor treated as lessers. The Ironkin are simply designed to want to be helpful. However, they can only imitate the emotions of the squats, and it is rare, but not unknown, for an Ironkin to possess ambition or seek to become a leader.
Three very quick thoughts:
1. The Votann are remnants of humanity from the time when our Terran super-AIs ('Men of Gold') had built advanced ship-based AIs ('Men of Stone') to enable long-sleep-style interstellar colonization, and the enigmatic "Votann Cores" that guide them(/are them) are strongly hinted to be those same AIs, just degraded over ~19,000 years. They were sidelined later on, after humans discovered FTL through an alternate dimension, 'the immaterium'.
2. The story is very obviously based on Dune, and like everything else in 40k is turned up to 11 and stripped of nuance for effect. Some sentient robots ('Men of Iron') "revolted" after ~three millenia of brutal, Star Wars-style slavery, but the overarching "Age of Strife" was about human wars in an non-unified galaxy, with the robots being a primary weapon; the actual revolt/jihad was a symptom, just like it was in Dune.
3. The 'Adeptus Mechanicus' mentioned above are a parody of cargo cults (religions that worship technology they don't understand) mixed with a dystopian take on the themes of A Canticle for Lebowitz, and are very much depicted with derision. Whatever your thoughts are on AI, dear reader, please never say "abominable intelligence" like it's wisdom rather than the fruit of a dogmatic & ineffective cult!
Of course, 40k lore is notoriously amorphous; some authors have said/hinted otherwise. But I think the above interpretation is the most coherent and interesting and supported overall, IMHO. For example, #2 is supported by the fact that the space elves ('Aeldari'/Eldar) ruled the galaxy at the time and seemed unconcerned by humanity's antics, which wouldn't make sense in light of an actual ASI threat proper.
> 1. The Votann are remnants of humanity from the time when our Terran super-AIs ('Men of Gold') had built advanced ship-based AIs ('Men of Stone') to enable long-sleep-style interstellar colonization, and the enigmatic "Votann Cores" that guide them(/are them) are strongly hinted to be those same AIs, just degraded over ~19,000 years. They were sidelined later on, after humans discovered FTL through an alternate dimension, 'the immaterium'.
For me, I really love the fact that they introduced a xenos faction descendant of man.
> 2. The story is very obviously based on Dune, and like everything else in 40k is turned up to 11 and stripped of nuance for effect. Some sentient robots ('Men of Iron') "revolted" after ~three millenia of brutal, Star Wars-style slavery, but the overarching "Age of Strife" was about human wars in an non-unified galaxy, with the robots being a primary weapon; the actual revolt/jihad was a symptom, just like it was in Dune.
It's important to highlight the age of strife was brought on in part by the birth of Slaanesh and the resulting warp storms breaking down system to system connections. It weren't just our dabblings in AI.
> 3. The 'Adeptus Mechanicus' mentioned above are a parody of cargo cults (religions that worship technology they don't understand) mixed with a dystopian take on the themes of A Canticle for Lebowitz, and are very much depicted with derision. Whatever your thoughts are on AI, dear reader, please never say "abominable intelligence" like it's wisdom rather than the fruit of a dogmatic & ineffective cult!
I've never been exposed to A Canticle for Lebowitz; thank you so much for the comment.
So yes, anything that is supposed policy in the Imperium is supposed to be taken with buckets of salt.
(Or "spice" might be synthesized. In Herbert's day (the 1960s) organic chemistry wasn't up to synthesizing arbitrary small-molecule drugs, but now it is. It's a service you can order on line, even. Biologicals take more work, but that's what genetic engineering is for.)
The "mental powers" in Dune aren't that impressive. Compare, say, the Harry Potter universe. In Dune, mentats can convince people. Bene Gesserit can look up stuff in their genetic past. Some people can multitask. There are apps for that.
Herbert wanted knife fighters to matter in battle. Not going to happen. Militaries teach knife fighting to build aggression and for desperate situations, but nobody's battle plan depends on a knife fight. Needs too much surprise. Marines say that their K-Bar knife is useful for everything but combat. Knife fighters, even with force shields, would be vulnerable to riot control weapons, from tear gas to guns that throw sticky nets. Or to being run over and buried by tanks with bulldozer blades, which the US used in the Gulf War. Herbert wrote before a big, modern, desert war.
So the Butlerian Jihad exists only in a plot-armored world specifically designed to make it work.
https://acoup.blog/2026/02/24/collections-warfare-in-dune-pa...
Armor and dart guns exist in dune. Not to mention poison gas. I don't know if riot shields would help much.
They also have rockets and lasers in dune, so those tanks and bulldozers will probably be ambushed like the rest of the spice harvesters, and they require supply lines for diesel. All that equipment also has to be shipped into arrakis, which is expensive, and the harkonnen didn't maintain their equipment very well anyways in a despirate attempt to extract as much wealth as quickly as possible. The lasers are effective on dune where shield use is limited because it attracts sandworms.
Even conventional artillery is used to destroy the cave systems, which play an important role in the book (and in real life if you consider this US-Iran war). Not to mention nuclear weapons exist on the planet and play a key role in diplomacy.
What happened in dune is more like what we saw when the US recently pulled out of afganistan.
Most of the important conflict in dune isn't based on knife fighting, the war revolves around raids, smuggling, suprise attacks, and the destruction and siezure of key pieces of equipment (like spice harvesters, spacecraft, atomics). The knife fighting is only really pivotal in champion combat.
>Marines say that their K-Bar knife is useful for everything but combat.
Okay but if they lived in a world where firearms were often useless against many enemies, and the flow of war was based on operating and siezing equipment, it would make sense for them to only carry a knife and not a gun. A knife is more general-purpose even as you describe. In dune the knives also have cultural value which is what makes the champion combat relevant in the first place.
>Arrakis is important because it grows "spice". Otherwise it would be a useless and planet
If it wasn't for the spice, arrakis could be a habitable, green planet. It's engineered to be a desert to facilitate the production of spice, as explained by kynes.
What isn't explained is why, when their chief Arrakis-ologist went native, they didn't replace him with multiple others.
I have seen a critical analysis that sees the origin of Dune as a roman à clef of the rise of the house of Ibn Saud.
Arrakis is Saudi Arabia.
Spice, melange, is oil: the surrounding empire needs it for travel and transport.
House Atreides is the Saud dynasty, which defeated House Harkonnnen.
Any resource heavy planet/country would be irrelevant if it wasn’t for its resources, what’s your point?
> (Or "spice" might be synthesized. In Herbert's day (the 1960s) organic chemistry wasn't up to synthesizing arbitrary small-molecule drugs, but now it is. It's a service you can order on line, even. Biologicals take more work, but that's what genetic engineering is for.)
Bene Tleilax managed to clone of the main characters from his dead cells, and repeat the process for thousand years, they have face dancers who can change their appearance at will. Do you seriously think they wouldn’t synthesize spice if they could? Maybe they could, maybe they couldn’t. Without going into spoilers territory, nobody would permit to disrupt arrakis monopoly on spice.
> The "mental powers" in Dune aren't that impressive. Compare, say, the Harry Potter universe. In Dune, mentats can convince people. Bene Gesserit can look up stuff in their genetic past. Some people can multitask. There are apps for that.
Because it’s a story about human evolution, and not wizards?
> Herbert wanted knife fighters to matter in battle. Not going to happen. Militaries teach knife fighting to build aggression and for desperate situations, but nobody's battle plan depends on a knife fight.
Do militaries also teach how to use a shield that is impenetrable to conventional guns?
> Knife fighters, even with force shields, would be vulnerable to riot control weapons, from tear gas to guns that throw sticky nets.
That’s why most fights in the book and movies require element of surprise and not an outright medieval clash between armies.
> Or to being run over and buried by tanks with bulldozer blades, which the US used in the Gulf War. Herbert wrote before a big, modern, desert war.
Which would be mowed by lasguns?
For one thing, the guild navigators are prescient and guide their ships across interstellar (and even intergalactic) distances faster than the speed of light. They use their prescience to pick routes where the ship arrives safely instead of plowing through a stray planet. They also use it in a less obvious fashion to maintain the political status quo. They try to avert political crises because they like their position in society and don’t want anyone changing things (which explains the long stasis of the Empire). People did at one point use computers for safe navigation, but they were slower and they weren’t prescient. The possibility that prescient machines might one day be built is the entire reason why Leto II spends so much time breeding humans in “God Emperor of Dune”. He’s looking for anything that can be an edge against the machines, and he hits the jackpot when he discovers that one of his descendants is not prescient, but is invisible to prescients. She and her actions cannot be seen in future he predicts. She and her descendants can safeguard humanity against any form of hostile prescience, machine or alien or otherwise.
Synthesis of spice was a long–term plot element in the series. The Tleilaxu eventually master it. Keep in mind that it isn’t a small–molecule drug either; it’s an alien life form.
Mentats were intended to be a replacement for computers and databases. They were frequently administrators and advisors, and often used their capabilities to convince people. But that wasn’t the goal of their training.
The Bene Gesserit have eidetic access to every memory of every one of their female ancestors. That is actually very impressive; most people don’t even have eidetic access to their _own_ memories, let alone the ability to easily recall secret information known only to their ancestors (such as the password to a safe). The Reverend Mothers can transfer all of their ancestral memories to another, so that the new Reverend Mother has access to the memories of both sets of ancestors. Long chains of Reverend Mothers gifting their memories to each successive Reverend Mother results in the Bene Gesserit having access to the ancestral memories of virtually every race or group of people that ever existed (except the Jewish, who successfully hid themselves even from the Bene Gesserit but otherwise still exist, which is a plot point in one of the later novels).
They can also command people to act. By a trained effort of will they can tell you to get up and dance a jig, or to slit your own throat, and you’d do it. That’s an ability worth respecting, which explains why the Baron Harkonnen took care to put a deaf guard in charge of a Bene Gesserit prisoner.
> So the Butlerian Jihad exists only in a plot-armored world specifically designed to make it work.
Ultimately, however, none of that matters because this statement is what you’re really intending to argue. It’s overly reductive, and it can apply to any work of fiction. Authors naturally build or select a setting where their story makes sense. Frank Herbert (and a few others like Tolkien), went further than that and invented world–building. This excited a lot of people and sold a lot of books, and now you’re cynically dismissing it by calling it “plot armor”.
Ultimately Herbert’s point was that people should strive to be humans, not animals or machines or slaves to people with superpowers. You can’t dismiss this philosophical stance merely because he used a fictional world to illustrate it. It can be true in the real world just as it is in his books, so to refute it you will have to be more clever than that. More human, perhaps he would say.
Could even envision it in some future film. E.g. when NCC-1701-N goes to warp in addition to the blur effect all the stars swell up.
What happens for V>c is of course undefined, and practically speaking, turning dots of light into even-skinnier dots of light would be boring AF to watch, so space travel in visual media ALWAYS does the stretchy-thing.
But that’s not really important. Science fiction is allowed to make things up that aren’t perfectly realistic. Campbell surmised that a good science fiction author would pick just one unrealistic thing, such as FTL space travel, for every story, and the reader would oblige by suspending their disbelief. Frank Herbert might have stretched that a bit but I still think he wrote a good story. I don’t hold it against him.
>We're as readers meant to take the extremist "correct" position that of course labor is its own virtue and that therefore automating anything is wrong.
I don't think the book forces the reader to take a position on anything. It just portrays a brutal yet intricate medieval-like society.
It is only sci-fi and not fantasy in the sense that some people are concious of their role as both a cause and effect of ecology. (Whereas in our modern society we are only the cause, and in our ancient history we are only an effect).
The reason why everyone's hands are tied is because they are constrained by politics/war/religion/culture/economics/technology and if you tug the thread back the it all goes back to ecology. The key mover in the plot isn't paul but pardot kynes.
Edit:
Shower thought. There is a fifth element in dune that is able to free people from their political/religious/cultural/economic constraints. It's love. People do irrational things out of love. Paul Atredies was a forbidden love child, and his existence is the impetus for the whole conflict and his existence as a messiah destroys pardot kynes' post-mortem plan.
Of course the book mostly takes place on a world with so little infrastructure that most of the goods are made offworld and imported. The native Freemen population makes plenty of stuff out of local resources, but they want to or have to stay hidden from the rest of society and so they don’t have any factories. The stillsuits they wear are hand made, but are exquisitely high–tech and display an ethos of perfectionism in their construction.
Also you might not have picked up that anyone able to afford a small amount of spice in their diet can live for much longer than anyone does today, and even the average person enjoys a wealth of products from hundreds of planets. House Atreides made their fortune harvesting whale fur and selling the clothes and other products made from it. At some point in history they became a Great House by arming themselves with nuclear weapons. There’s a form of personal wealth that doesn’t quite exist today! :)
what does the Butlerian Jihad “working” mean?
Indeed.
What are some other fictional universes with interesting takes on AI and humans? I think the Hyperion cantos (at least books 1 and 2) are great. Stross's Accelerando also has some wild ideas but feels maybe less directly relevant.
Agreed. But would our AI entrepreneurs, so busy building the Torment Nexus, pay heed?
I was fairly surprised when his son wrote a novel that felt like a generic, bland robots run amok storyline that happened, more or less, because one guy/titan "ruined a good thing" by telling his AI to run in permissionless mode.
the other jihad in the first novel is that of the Fremen, which is described as being unspeakable violent, so I find it hard to imagine these to be different in that regard.
It doesn’t talk too much about political conditions the city Fremen lived under, but the Harkonnens don’t seem to be too keen on civil liberties so we can probably make an educated guess.
In the second book, the Fremen have established a brutally repressive theocracy that is obsessed with rooting out heresy. Regular people being afraid to openly speak their minds about political issues is a plot point.
"Jihad" is an Arabic word meaning "struggle", and usually used in English to mean "violent religious war". Are you unaware of this blatant plot hint?
People keep putting the cart before the horse on this one, and the degree to which modern people have been lulled by fiction is quite worrying. Amusing ourselves to death.
Absolutely. Walter Jon Williams explicitly made this point in the introduction to the Praxis trilogy:
https://en.wikipedia.org/wiki/Dread_Empire%27s_Fall
He said that to make space opera work, you needed to not have omniscient AI, FTL travel, and nanotech that could work miracles, resurrect the dead, and give lifeforms superpowers.
So, how to forbid it, when someone somewhere will try very very hard to make it?
By imposing a cultural ban. His empire-building aliens forbid it, on pain of genocide.
That gave him a setting. Then, what if that empire falls? That gave him the nugget of a plot.
I found it a very effective setting, myself.
the immediate cause of the Jihad is the abortion of the healthy fetus of a Bene Gesserit, Jehanne Butler, by an AI."
I mean this in both the specific and general sense.
Mostly vs machine operator humans, but indirectly against the machines too.
The originals, all of which I've read and which I think are pretty good, are by Frank Herbert, between the mid-1960s and mid-1980s.
Then, 20+ years later, his son Brian Herbert and prolific author of tie-ins Kevin J Anderson started writing sequels and prequels.
Now TBH I have not read any of these, but the reviews are terrible, and I have read one Brian Herbert novel and one Kevin Anderson novel, and both of those were among the worst books I have ever read in my life. In the pre-internet era I read a huge amount -- I'd guess 20 thousand or more -- and both authors are in my top 5 worst ever books I ever finished.
You're referring to stuff that never happened in the original novels. In those, the Butlerian Jihad was ancient nearly-forgotten memory, many millennia ago. Longer before the times of the novels than Ancient Egypt is before us today.
So, the comment and the discussion is IMHO mainly about the original novels, and you're talking about stuff from the awful cash-in books by the author's son and a writer mainly known for cashing in on movie franchises.
That's why I said you read the wrong books.
The early evidence isn’t good, but I do believe with deliberate and thoughtful training our brains our capable of much more than we currently give them credit for.
We should strive for a society where day-to-day life makes a baseline mental fitness a natural outcome as well.
I imagine the answer looks something like Wordle writ large: Replacing passive time consumption activities with interactive ones that are as readily accessible (“walkable”).
There’s a fun scene in Star Trek: The Next Generation where LeVar Burton’s chief engineer character is on a long shuttle ride by himself. In addition to sipping a synthehol cocktail, he asks the computer to play a verbal game. It chooses to give him a quiz in his domain of warp field mechanics, and because it’s a smart AI, it calibrates the questions to be just at the limits of his knowledge.
Obesity is actually decreasing today, due to GLP-1 receptor agonists. We are already over peak obesity.
Hug me till you drug me, honey;
Kiss me till I'm in a coma;
Hug me, honey, snuggly bunny,
Love's as good as soma."
Still, I'm optimistic. With obesity, who cares about the underlying cause if you can easily cure the symptoms?I'm sorry, what? Heavy assistance? The overwhelming majority of people are completely capable of walking on their own two feet. The number of people relying on "heavy assistance" for "basic locomotion" is overwhelmingly tiny, and primarily limited to the elderly
We’ll need to build a nose for the right kind of information. Kids growing up in this world already are better at it than older folks who are newly thrown into this environment.
But beyond that I think our agency has already been sapped, as a species. Rebuilding the muscle to exercise our agency as free citizens using the information at our command to make better decisions… we shouldn’t surrender this ability to AI. The best science fiction and science writing already gives us plenty of reason to avoid this. We don’t need to get to the worst of it, and have all out war to correct it.
And that does mean investing heavily in human education. Getting better at teaching things to adults. Making insight easier to gain at every strata of society so true freedom of information when it comes to public works and governance is achieved, which makes the people the watchers and owners of government.
No easy thing to do. Absolutely doable, technologically speaking and in terms of our current biology.
What we have is years of thinking we’re not capable enough. Or cooperative enough. Or rational enough. We can be. We just need the right context, a full belly, and practice in using our voices and shaping our futures actively.
Since the botlickers think that those of us who don't trust automatic plagiarism machines are religious nutcases anyway, why not lean into it?
I'm thinking of having T-shirts printed up.
On the front, "Butlerian Jihadi" in some attractively faux-Arabic font.
Perhaps on the back, in Old English Black Letter:
Thou shalt not
make a machine
in the image
of a human mind.It made me think about the book of the new sun. you think its half man half monster creatures are unrealistic? give it a couple thousand years. good sci-fi really is prescient
In the Urth of the New Sun for example he has a kind of AI lock, the only function of which is to recognize a person and open only to that person. Being in that role for thousands of years, some of the locks develop a kind of personality or at least personal traits, but they are totally defined by and cannot exceed the role they were initially given, nor do they want to. It is still a haunting image for me how personality or something close to a soul might be an accidental byproduct of something as mundane as wanting to have a convenient lock. And of course you cannot stop to wonder how far we are from that.
In Book of the new sun there is the Green Man who Severian saves from imprisonment. He only appears on a few pages but we learn that he is from a distant time where mankind incorporated plant cells in their genetic makeup in order to perform photosynthesis. That brilliantly plays on two themes of the book: the sun as live giving and how a single person can be independent (or "autarch"), here in so far as producing their own energy.
There are many more instances and it’s what makes the Book of the New Sun or the Solar Cycle so fantastic. The future is so vast and strange here, that it cannot be fully depicted and ideas which another writer would stake a whole book or series on are only good for a few lines.
Blocked, for me. Not paywalled: the entire site.
So...
The techno-fascists of today. We are already there.
Also, quoting the first Dune novel:
> Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.
That's just what the zeitgeist of the time was.
Computers were then just appearing (or increasing) in the public discussion, along with fears that they'll make humans less human somehow.
Like in this Computer Chronicles video about word processing [0] from 1983 at 4:08: "Some writers are concerned that computer assistance may promote dry bland writing."
Terminator appeared in 1984, and the first Alien movie in 1979 had an antagonist android. 2001 A Space Odyssey with a disagreeable AI came out in 1968. All way before the real world had anything remotely close to today's AI: It was a reaction to the appearance of computers themselves.
That just shows that humans have the same reactions whenever a new world-changing technology appears.
On the other hand, Star Trek had Data.
Ironically, the tech that people and media were mostly optimistic about turned out to be more dystopian than predicted: The internet :')
Yeah, it seems absurd to be afraid of computer-assisted writing in the WordStar era, but the Turing test was proposed in the 50s. Everyone knew that human fields of endeavor would only become "more computer" as time went on. Only, if a time traveller could tell a 70s-era sci-fi writer that artists and designers were some of the first to have their livelihoods threatened by 20s-era AI, they'd probably think it was too on the nose to incorporate into their fiction.
https://bookblast.org/blog/the-sabres-of-paradise-the-book-t...
EDIT: The formatting error in the Glossary entry "Sandsnork" is still there though.
Dune's Butlerian Jihad and the Future of AI
The first reaction is a scoff and a laugh of course - wasn't the original temperance movement an utter failure, prohibition didn't work etc. But no, the movement was far wider and successful in a multitude of ways. And a new temperance movement isn't about blindly copying something old, but situating yourself around the turn of the 20th century, understanding the multitude of interconnected problems people faced, the solutions they came up with and which ones worked and didn't.
America at the turn of the 20th century was a nasty place - there was wild corruption, politics was run by mafia-like patronage networks, wealth was extremely concentrated, rich people were unaccountable, working people suffered under low-paying, dangerous jobs, women were excluded from public life, and alcohol was merely the symptom of a very sick society, and yes indeed it was a massive problem, the way alcoholism is a massive problem in Russia today.
The original temperance movement was bound up tightly with the Suffarage movement (giving women a voice), with Taylorism (running organizations rationally), with income tax (a fairer less corruptible source of income for the federal government than tariffs and excise taxes).
Today's problems are thematically the same - massive concentration of wealth is making an unaccountable elite wielding power against the wishes of the public, creating dangerously addictive digital products, massive increase in gambling, restricting the rights of poeple to own and repair products, working to disenfranchise people, working to roll back women's participation in public life, etc etc. So sex, alcohol and drugs are not an issue today, but gambling, addiction, disenfranchisement, exploitative business practices, mind-boggling amounts of corruption - they're all back in the same form and for the same reasons, and we'll need the same type of movement to fight against them.
What the progressives of the early 20th century did was not abolish capitalism, but tame it. We don't need to go on a jihad against AI, but we do need to yoke it and disempower the current slate of people who own it and direct it.
Another outgrowth: Alcoholics Anonymous. It was a reaction to the end of Prohibition, turning the prohibition internal rather than universal.
what is sex referring to in this context? is this talking about societal attitudes toward sex, sex as in gender, or something else?
Or, to bring it closer to home, in the words of the God Emperor of Dune:
> "The favorite poetry? The Epic. The popular dramatic ideal? Heroism. Dances? Wildly abandoned."
> "What did I take from them? The right to participate in history."
…where the Tyrant violently suppresses all of these, because such art is politically dangerous as it reminds people of the agency they've lost.
The first has been covered: "Once men turned their thinking over to machine ... that only permitted other men with machines to enslave them." Men did the enslaving. It describes a techbro oligarch takeover, not an AI takeover. The machines do not have agency.
Hebert was really into the whole idea now expressed as "Hard times create strong men. Strong men create good times. Good times create weak men. And, weak men create hard times." i.e. good times, people get lazy, then get weak, then get enslaved. (1)
And the second is that "Thou shalt not make a machine in the likeness of a human mind" is not the same thing as "Though shalt not make a machine mind". A drawing or statue of a person is "in the likeness" of that person. It's not a person. It doesn't have to actually be the thing in order to qualify as "likeness" of it.
People who scorn LLMs would agree that they produce something like the output of a human, in the sense that a parody, a caricature, a cartoon is a likeness. An uncanny valley mockery of the thing is "in the likeness" of a thing.
Ultimately, Herbert put this in his fiction because he didn't want to write about robots or machines, just humans and human potential (2). So he wrote it out with a few paragraphs of backstory in the novels' distant past. You can over-interpret it. Herbert wanted to sound deep, but he did not always succeed. And even when he succeeded in that, his views were not always the best.
1) https://acoup.blog/2020/01/17/collections-the-fremen-mirage-...
However, I deeply appreciate the rich world and captivating narrative it enabled, and I think this is what Frank Herbert was going for. He wanted the intricate dynamics of the Guild and Spice and Mentats and exciting close-quarter combat for a more intriguing narrative. But AI and robots would have obviated all of those, so he made it disappear with a handwave of "because Butlerian Jihad."
But history has already shown us that manipulation of belief and religion is a more effective and cheaper means of control than technocratic methods. A giant technocratic surveillance dystopia is possible, but it costs a lot more than old fashioned dogmatism with enforcement through herd behavior.
So we smashed religion, a kind of anti-Butlerian Jihad we call the Enlightenment, but the human lust for power and control just followed us into the machine age. If we smash the machines, we'll just end up back where we were. It will follow us there too.
Of course you could say this was one of the sub-themes of Dune, since (reading comprehension test!) Paul is not a hero. He's a religious manipulator, though a bit of a tragic villain in the sense that he feels dragged into it by fate.
IRL I don't think humanity will ever escape this cycle until we can define what freedom even means and reduce it to first principles. Does having thinking machines do my thinking for me increase or decrease my freedom? Does having a religious orthodoxy make my life choices for me increase or decrease my freedom? What's the third alternative, and do we really need to smash either religion or technology to get it?
The "jihad" part wouldn't work so well in the movie, so of course they had to go with "holy war". You can't exactly have Timothee Chalemet waving a crysknife around and yelling "JIHAD!!!" in the post-9/11, post-GWOT era.
honestly I wish he did. The films are already incredibly on the nose, much more so than the books, that Paul is not to be understood as a hero. Practically half his dialog is directly talking to the audience telling us how he's going to kill billions of people. Chani got a very different role, and we start and end the movies from her perspective to stress it even further.
If you're already doing this you might as well have not chickened out on the language, it was one of the few things that genuinely irked me about the film.
God I wish he had written 1000 more novels. Every single one of his stories is phenomenal, even the non culture stuff. The Wasp Factory was the first of his novels I read. Imagine my surprise and elation in finding that most of his other works were absolute top tier sci-fi.
(Several characters in the novels comment on this, so it is entirely cannon.)
The Culture fought a war against the Idirans, who eschew the use of intelligent machines. The Idirans lost.
Similarly, the Gzilt civilisation in the novel The Hydrogen Sonata prefer to run their ships with a quorum of uploaded humanoid mind states running at highly accelerated speeds.
Humanoids in the Culture are controlled at every level, even their thoughts as guided… sorry… “aligned” with the Minds through the adoption of the language Marain.
No humanoid ever overrules a ship Mind in the novels.
They're an anarchistic society, no one has power to overrule any one else.
https://www.reddit.com/r/TheCulture/comments/kbtylt/ysk_the_...
Just as shippers can successfully take two characters who clearly have no basis for a romantic or sexual relationship and pair them off in their head canon, likewise people can disregard the author's statements about their work and decide it's completely contrary to how they've decided to understand it.
Some people look at https://en.wikipedia.org/wiki/Fountain_(Duchamp) and they do not see a sculpture.
Both Vyr Cossont and Ngaroe QiRia are so bored with their meaningless existence that they have to go out of their way to invent “life tasks” and other challenges to immerse themselves in.
Not to mention the scene where a ship mind casually crushes the spirits of Vyr by perfectly playing a piece on its first attempt that she struggled with for years!
While there are some types of people that would be bored and would struggle in Culture-style utopia, I think for overwhelming majority of people it would still be a massive improvement over today's world.
It doesn't.
>struggle [...] hardwired into living beings, without which they wither away
The reason Sisyphus is happy (or so we imagine) is not because he's struggling for all eternity
Nope, they have considerable freedom, arguably greater than we have today. It's true that they cannot directly challenge the almost onmipotent Minds when it comes to stuff that matters to them, but Minds in Culture are an example of a very well-aligned AI, so it's almost always the case that going against a Mind's intent will just make the situation worse for everyone.
Dune's central theme about balancing power and authority is much more prescient for our time, but I suppose we'll have to wait for Villeneuve's Part 3 before Silicon Valley discusses it.
> “Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.”
What else needs to be said? We see examples of this throughout human history all the time. People thought at the early onset of the industrialization that people would become freer by leaving feudalism but all it did was immiserate workers for another 130 years (immiseration still ongoing in certain areas of the world).
It's basically rentierism taken to the extremes.
Also, Herbert's point about dependence on machines creating machine-dependent humans, trapped in a deterministic arc of evolution, feeds into his larger themes about open-ended evolution and its arms-race. It's not just a throwaway backstory.
And Herbert explores this larger theme even beyond his Dune series:
"Surprise me, Holy Void!" (says the Ship once freed)
Then later, I saw their handiwork in person: they would take an angle-grinder and obliterate the QR Code from those rental e-Scooters, slap on a BJ sticker or three, and then leave them where they found them. This would render the scooters as e-waste, un-rentable and blocking the sidewalks.
I would not be surprised if they are quietly influencing groups which are agitating against AI Data Centers. But the BJ I have seen is a chaotic group of direct urban sabotage.
All he mentioned explicitly was the very last clause, but the others are more important & uniquely-Dunean IMHO, and are central to the plot from the jump through the Bene Gesserit, the Mentats, and the Guild Navigators, all ostensibly Homo sapiens sapiens despite being completely unnatural. Even "Imperial Conditioning" --which obviously plays the biggest part in the first act of the first book-- is arguably the same topic. By refusing to include computers and robots at all, the reader is naturally guided to consider those more familiar tropes in light of the world-building snippets we get. Which is kinda what makes Dune so genius, I think!
Like, to make it explicit... I think having the aforementioned abhumans drive the plot without significant support from inhuman minds raises more subtle questions than we're used to in far-future tales of robots, like:
1. Can one lose their humanity through experience, be it intentional "conditioning" or just the acquisition of power? (see: Paul vis-a-vis Eichmann in Jerusalem)
2. Once one has lost their humanity superficially, can it be brought back/up/forward? Is love/greif the most plausible path, and thus the most human cognitive processes? (see: Dr. Yueh vis-a-vis Eichmann in Jerusalem)
3. If we try to maintain our humanity in the long term --the default goal of non-insane futurists, though debated in the 21st c.[1][2]-- how do we protect against the natural urge to pursue power, which is (arguably) inherently human?[3]
I'll cut it off there cause this threat will likely be deleted anyway and I'm heavily procrastinating. Long story short: the Butlerian Jihad is not a condemnation of artificial minds, and if even it were, the condemnation would apply equally as much if not more so to the humanist empire in which the story is set.
Also, hopefully obvious, but just in case: it likely began as an excuse to write the stories that he wanted to write, just like the shield thing giving an excuse for swords in space. But I think Herbert deserves credit for what was running underneath that and elaborated on as it became a series of novels rather than cute periodical stories. He was pretty smart!
Also also: we do not discuss the son's book about Butler lol. It is verboten.
[1]: https://en.wikipedia.org/wiki/He_Jiankui_affair
[2]: https://en.wikipedia.org/wiki/How_We_Became_Posthuman
[3]: This kind of structural conflict could be described as 'internal contradiction' https://en.wikipedia.org/wiki/Dialectical_materialism or 'endogenous contradiction' https://en.wikipedia.org/wiki/Endogeneity_(econometrics) depending on your preferred flavor of economics.
Here’s how it went down in the dune universe (I’m certainly messing up some details, but these are the broad strokes):
Humanity has spread to the stars. No FTL involved, just good old fashioned sublight engines. The dune universe takes place about 50-60,000 years in our future. Mankind has spread across a couple dozen solar systems and everything is going peachy. However, mankind gets complacent, fat, and happy with their success and society stagnates. A handful of eager, ambitious humans scheme about how they can take it all over. They do, and then eventually start turning themselves into cyborgs, or disembodies brains in a jars that swap bodies and are effectively immortal. One of the cyborgs gets lazy and makes an AI to manage things, which promptly takes over, overthrows the cyborg rulers of humanity, makes the cyborgs it’s slaves (who have great autonomy/are conspirators) and generally rules over everything. A small group of solar systems is left under human control, who fall back to a feudal-ish type system of government with lords and dukes and whatnot.
The AI does all sorts of nasty shit to the humans in it’s dominion. Unit 931 and Auschwitz type experiences, slavery until death, etc. Untold billions, if not trillions, of humans live in animal-like conditons worked to death. The human group of systems isn’t cool with this, but they can’t do much and are vastly overpowered by the cyborgs, so a fragile peace is held. One day, the son of one of the subservient cyborgs knocks up a human slave, and they have a kid. In the background, all sorts of rabble rousing and shenanigans are being done to stir unrest amoungst the slaves by the free human system. The human systems develop FTL, with spice as a catalyst, except it doesn’t work 10% of the time and kills the pilots. The AI’s main henchman (who does all of the nazi and Unit 931-type experiments) decides it would be cool to kill the baby of the cyborg son and the slave. The slaves last name was “Butler”/ This sparks a massive revolt by the slave worlds. The free human systems then go on to fight a prolonged war against the machines, using the FTL drive at great loss of life, to begin a “Butlarian jihad” to free the humans from thinking machines. Lots of other stuff happens, and humanity eventually wins, but this is why machines no more advanced than a desktop machine are allowed in the dune universe, and why they technologically hobble themselves.
Hard disagreement.
My issue is not with the work on its own merits (although I think its pretty generic mass-market SF), but rather that it is wearing the skin of something it is not and to which it has no honest claim. It is one thing for an author to take a well-regarded prior work and attempt to complete or expand it. For example, Brandon Sanderson's work completing Robert Jordan's epic Wheel of Time is very respectable; he tried to complete the series as Jordan would have done. It is quite another to take the name and setting of such a work, steal the surface detail and use it to dress up one's own story that shares nothing of the underlying body or soul of the work - such enterprises are an insult to the original author, the reader, and the self-respect of the new author.
Interesting backstory about this name. Of course, it is an "occupational surname" and means "bottler" or "cup-bearer". The Butler Dynasty was a notable and very influential noble family in Ireland, beginning a century after the Norman Invasion of England.
https://en.wikipedia.org/wiki/Butler_dynasty
Now Franklin Patrick Herbert, being of Irish and German descent, and naturally a student of history, would've been quite aware of the power and influence of the medieval Butlers in history. And some of this renown was brought to American shores, as well.
In learning of my birth family and tracing our origins back to the birth of America, I discovered that my paternal line had come from Butler County, PA. They arrived in the late 18th century and homesteaded large swaths of this region near Pittsburgh. They had prospered, especially from mineral rights on the land, and the Irish Catholic immigrants had intermarried with German Catholics who homesteaded nearby. (Often, entire counties in the area were pioneered by immigrants from a certain part of Europe. And the intermarriage was a natural result of sharing a common faith.)
So for several years before 2024, I was known as the guy in genealogical circles who was hunting down information about Butler County, and I was fairly proud of finding my family roots in that county, and I mentioned it all the time in the Irish pub and everywhere else. Well, imagine my shock when the little incident happened on July 13th, 2024. I have been more reticent to discuss Butler County since that time.
Anyway, I find it interesting that Herbert chose that particular name for the "Anti-AI crusade". And that is partly why I chose the moniker for my own, despite not being particularly anti-AI (remember, all my comments are generated by a neural net), nor having read any of the books, or seen the films. (I did attempt to watch the Lynch film, but it really did not hold my interest! So sue me!)