HNHacker News
TopNewBestAskShowJobs

YeGoblynQueenne

24,940 karma · joined September 26, 2015

This a common question on this board:

What is reasoning?

In computer science and AI when we say "reasoning" we mean that we have a theory and we can derive the consequences of the theory by application of some inference procedure.

A theory is a set of facts and rules about some environment of interest: the real world, mathematics, language, etc. Facts are things we know (or assume) to be true: they can be direct observations, or implied, guesses. Rules are conditionally true and so most easily understood as implications: if we know some facts are true we can conclude that some other facts must also be true. An inference procedure is some system of rules, separate from the theory, that tells us how we can combine the rules and facts of the theory to squeeze out new facts, or new rules.

There are three types of reasoning, what we may call modes of inference: deduction, induction and abduction. Informally, deduction means that we start with a set of rules and derive new unobserved facts, implied by the rules; induction means that we start with a set of rules and some observations and derive new rules that imply the observations; and abduction means that we start with some rules and some observations and derive new unobserved facts that imply the observations.

It's easier to understand all this with examples.

One example of deductive reasoning is planning, or automated planning and scheduling, a field of classical AI research. Planning is the "model-based approach to autonomous behaviour", according to the textbook on planning by Geffner and Bonnet. An autonomous agent starts with a "model" that describes the environment in which the agent is to operate as a set of entities with discrete states, and a set of actions that the agent can take to change those states. The agent is given a goal, an instance of its model, and it must find a sequence of actions, that we call a "plan", to take the entities in the model from their current state to the state in the goal. This is usually achieved by casting the planning problem as pathfinding over a graph with a search algorithm like A*. Here, the agent's model is a theory, the search algorithm is the inference procedure, and the plan is a consequence of the theory. Deductive reasoning can be sound, as long as the facts and rules in the theory are correct: from correct premises we can deduce correct conclusions. We know of sound deductive inference rules, e.g. A*, and Resolution, used in automated theorem proving and SAT-Solving, are sound.

The classic example of inductive reasoning is inferring the colour of swans. Most swans are white (apparently) so if we have only seen white swans we have no reason to believe there are any other colours: we are forced to infer that all swans are white. We may only be disabused of our fallacy if we happen to observe a swan that is not white, e.g. a black swan. But who is to say when such a magnificent creature will grace us with its presence, outside of Tchaikovsky's ballets? Induction is thus revealed to be unsound: even given true premises we can still arrive at the wrong conclusions. Another example is the scientific method: imagine an idealised scientist, perfectly spherical, in a frictionless vacuum. She starts with a scientific theory, then goes out into the world and makes new observations about a phenomenon not described by her theory. She constructs a hypothesis to extend her theory so as to explain the new observations. The hypothesis is a set of rules, where the premises are the consequences of the rules in her initial theory. Then, being an idealised scientist, she goes looking for new observations to refute her hypothesis. Science only gives us the tools to know when we're wrong.

Abductive reasoning is the mode of inference exemplified by Sherlock Holmes. We can imagine Sherlock and Watson standing outside a tavern in London, watching as a gentleman of interest steps out of the tavern with egg on his lapel. "Ah, my dear Watson, what can we conclude from this observation?". "Why my dear Holmes, we can conclude that the man had eggs for breakfast". Holmes and Watson can arrive at this conclusion, about a fact that they have not directly observed, because they have a theory with a rule that says "if one eats eggs, one may get some on one's lapels". Working backwards from this rule, and their observation of egg on the man's lapels, they can guess that he had eggs even if they didn't directly observe him doing so. Abduction is also unsound: the man may have swapped coats with an accomplice, who was the one who had eggs for breakfast instead.

And now you know what "reasoning" means. So the next time someone asks: "what is reasoning?", you can let them know and turn the discussion to more interesting, more productive directions.

submissionscomments
YeGoblynQueenne··on The recently proposed o(n log n) integer multiplication algorithm [pdf]
>> What do you see as the problem with it (let alone "crisis")?

The fact that he didn't read the paper and he's talking about it as if he did.

YeGoblynQueenne··on Dessa: Conversation Model trained only on speech
This is why we have a flag.
YeGoblynQueenne·
·on The recently proposed o(n log n) integer multiplication algorithm [pdf]
Oh, I read further, for example where he says he didn't read the paper. I don't understand how someone of the obvious mathematical ability of David Harvey would write something like that. I just hope he has someone to speak with because he sounds like he's going through some kind of crisis maybe.
YeGoblynQueenne··on Marshall Islands Stick Chart
Thanks but I was looking for a specific brand which was from Iran.
YeGoblynQueenne··on The recently proposed o(n log n) integer multiplication algorithm [pdf]
>> I have not checked most of the details, but I think that the claimed o(n log n) bound is plausible.

Oh? Well I have not checked most of the details either, but I think that the claimed o(n log n) bound is not plausible at all.

Can someone please check most of the details of the paper and resolve our disagreement with Mr Harvey?

YeGoblynQueenne··on WorldTUI: I trained a 360M model to pretend to be a terminal
Great way to get people to type in their passwords.
YeGoblynQueenne··on How the Elizabeth Holmes documentary “You Can See Everything” is deceiving
Which one? Whichever it is, it would hardly be sponsored by the meat industry innit.
YeGoblynQueenne··on Chaos ensues when AI interviewer meets AI interviewee
If you want a vision of the future imagine two bots saying goodbye to each other online forever.
YeGoblynQueenne··on Marshall Islands Stick Chart
Sour cherry jam? I used to be able to get that in the UK but no more.
YeGoblynQueenne··on Felix Rieseberg Homepage
Everything that ever had value went the same way: food, art, motorcycles, tourism... you visit somewhere or buy something that looks exciting and 9 times out of 10 it's soulless, industrially produced, mass-targeted and ends up worth less than the money you spent on it.

It's surprising to feel that way about code projects. For most people computers always were soulless machines without anything creative associated with them. Now we're in a strange inversion of history where people who never had any idea what to do with a computer suddenly feel very creative talking to the cloud to ask it to rain down some weird and wonderful thing on them that they feel proud to post about on their social media.

Weird times. Anyway just wanted to say you're not alone.

YeGoblynQueenne··on OpenAI withdraws three mathematical results
I didn't call you an idiot, nor thought you are one. Can you explain what your comment meant? Because I clearly did no understand it.
YeGoblynQueenne··on The Mathocalypse

  Scott Says:
  Comment #91 October 8th, 2026 at 12:34 am
  
  Jason #88:
  
      They threw 8,000+ problems at the wall and lesss than 400 stuck to it. I’m much more interested to see the transcripts from the 7,600+ that were discarded.
  
  ROFL. Why didn’t anyone ever think to say to Andrew Wiles, “forget about Fermat’s Last Whatever, tell us about all the math problems you couldn’t solve”?
  
  Anyway, my prediction in this post was exactly right. No matter what AI does, no matter what happens in external reality, cope springs eternal in the self-satisfied Internet commenter’s breast.
https://scottaaronson.blog/?p=10169#comment-2041180

Amazing. I have never known a mathematician dismiss a quantitative inquiry with such a flippant attitude. Yes, in machine learning research we like to measure the performance of our systems in fractional quantities, for example "we gave this system 100 problems and it solved 10: that's an accuracy/solve rate/pass@1 of 10%". Nothing wrong with that and nothing to cope with.

400 (to be charitable) divided by 8000 is 0.05. 5% accuracy (again charitably) is ... not great. Remember this is the revolutionary approach that is going to transform mathematics and solve all problems currently unsolved by humans. Quite unlike the expectations placed upon oh, I don't know, Andrew Wiles, for example. AI is going to leave mathematicians out of work because it can solve all maths.

All of them.

5% at a time. Now who's being willfully blind?

P.S. What an ungracious, rude blog host.

YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
I think that would be very difficult to say. Good or bad writing is subjective.
YeGoblynQueenne··on OpenAI withdraws three mathematical results
Not at all rudely. We're good!
YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
>> I do not claim to know OpenAI's intentions or reasoning when these results were released and am not arguing that it was done with improper intentions, only that whether it was done out of goodwill is not a settled matter.

That's right honourable of you but for me it is very clear that the only incentive in AI companies' effort to produce mathematical results is to advertise their technology. There is no reason at all to assume they have any other motive; certainly not any kind of interest in mathematics as such.

YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
Thanks for your perspective, genuinely.

What do you do if those results suck like in the article?

YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
OP is not dismissing AI progress, they're saying there's been no progress in writing better.
YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
>> Some people told themselves they were the pinnacle, the first-rate mind, as opposed to all the second-rater.

Wait, who are those people? Who is that Hardy and what did he really say? What did he really mean? Who else said or meant the same things?

Who are you criticising, exactly?

YeGoblynQueenne··on OpenAI, the Partition Principle, and Mathematics
"Climbing" is not the same as taking a trip on a funicular up the top of a mountain.
YeGoblynQueenne··on I think I found a planet nobody knew existed. I used Claude Code to find it
I never used old reddit when it was new. I sometimes end up on it from HN links. What is the difference, besides the UI?

To be clear: this is a genuine question and not an attempt to bait a flamewar. I honestly have no idea what the matter is. I have deliberately tried to avoid all social media other than HN for a very long time.

YeGoblynQueenne··on OpenAI withdraws three mathematical results
Just to be clear, I'm not trying to willfully misunderstand the OP's comment just to be argumentative. The OP said this:

>> All the human needs to verify is that the statement of the theorem is translated correctly from natural language to Lean. That usually covers a very small surface of the Lean code.

As far as I understand the comment "the statement of the theorem" is the declaration of the theorem to be proved, not its proof. That it "usually covers a very small surface of the Lean code" also implies that the OP was only referring to the theorem, the thing to be proved, and not the proof that can run into many thousands of lines.

If I misunderstood then I don't think that's a problem? I don't believe my comment above comes across as rude or an attack on the OP? I think it's normal for this site for users to correct one another without it being a cause for bad feelings.

YeGoblynQueenne··on OpenAI withdraws three mathematical results
>> I once worked with code that made me want to pull my hair out.

Only once?

Oh god, we're gonna do the four Yorkshiremen, aren't we?

YeGoblynQueenne··on OpenAI withdraws three mathematical results
>> This hardcore gatekeeping of math (and by extension STEM) fields MUST stop.

Is someone stopping you from studying maths?

YeGoblynQueenne··on OpenAI withdraws three mathematical results
If it was as simple as that we'd have many more computer-generated proofs than we have now and the Gen AI results would be unremarkable.

Take the Rieman hypothesis. All one would have to do to prove or disprove it would be to encode the statement of the hypothesis in Lean, press enter, and we're off to the races.

That's not how it works. Essentially you have to encode all the intermediary steps of the proof in Lean too, and then Lean can check their correctness for you and check that they lead to each other. But it won't just generate a whole proof from nothing. That is the whole point of the Gen AI math claims.

YeGoblynQueenne··on OpenAI withdraws three mathematical results
13 million lines?

And people laughed at Doug Lenat and Cyc for wanting to encode all knowledge as a set of rules.

YeGoblynQueenne··on Opus 5.5 agents discover two room-temperature magnetic semiconductor candidates
I mean, the experts can still make their own discoveries, right? Nothing forcing them to switch their career to validating others' slop, as you put it (and I agree).
YeGoblynQueenne··on Opus 5.5 agents discover two room-temperature magnetic semiconductor candidates
>> (I did a PhD in magnetic materials)

(The author didn't)

YeGoblynQueenne··on Dust: Pretraining Transformers Without Backpropagation
Bayes Optimal Classifier?
YeGoblynQueenne··on Why the Bronze Age Collapsed
It did, it devastated them, along with everyone else who was native to the region.
YeGoblynQueenne··on Why the Bronze Age Collapsed
>> These are excerpts from the Lienzo de Tlaxcala, a sixteenth-century manuscript painted by the Tlaxcalans, longtime rivals of the Aztecs, to record the conquest of Mexico by the Spanish. The Mesoamericans fought with weapons made from obsidian, a hard, jet-black stone that was very sharp but brittle. They were brutally outmatched by a European military armed with steel swords, gunpowder, and horses. Image credit: New Mexico History Museum.

I wonder if this is still a widely accepted view among historians and archeologists, that Cortés' men "brutally outmatched" the Aztecs. I have the feeling that a more nuanced image has emerged in more recent years, taking into account, for example, the alliance of the Spaniards to the above-mentioned Tlaxcalans and other Mesoamerican people who hated the Aztecs a lot more than they cared to hate the Spaniards, and who saw the Spaniards as a useful ally in their feud with Tenochtitlan [1] so that when the Spaniards fought the Aztecs, they had several thousands of Tlaxcallans and other allies on their side, enough to match the numbers of the Aztecs, but who are omitted from the telling of the story[2]. Smallpox also played a huge role in depopulating the region, including the cities of the Spaniards' allies. Then there was the way that the Mexicans and their enemies traditionally fought: primarily, not so much to kill but to take prisoners to sacrifice later, much unlike the Spaniards who were all business.

Additionally the superiority of the arms of the Spaniards (not just iron but also black powder and horses) was tested in La Noche Triste: The Sad Night [3], an event in which the Spaniards were savagely attacked and driven out of Tenochtitlan in an urban battle that resulted in many Spanish casualties, including the loss of all their artillery and many of their horses by the same Aztecs whom the Spaniards' superior military technology dominated in open field battles.

And let's not forget the Battle of Isandlwana [4]: 20,000 Zulu warriors, armed mainly with assegai spears and cowhide shields massacred 1500 British soldiers equipped with rifles and even a couple cannon and rocket batteries. Morale of the story: there is a lot more that goes into the killing of men than who has the bigger weapons: another lesson repeated throughout history.

_______________

[1] A pattern that repeats throughout history, e.g. the Middle Eastern states in the middle ages very quickly formed alliances with the Crusader states and the Westerners were fully integrated into local politics, and wars.

[2] Similar to how e.g. the ~2700 other Greeks that fought with Leonida's 300 Spartans are also often forgotten: https://en.wikipedia.org/wiki/Battle_of_Thermopylae#Greek_ar.... Not that it made a difference given the Persian numbers.

[3] https://en.wikipedia.org/wiki/La_Noche_Triste

Many years ago I read Bernal Diaz Del Castillo's *The True History of the Conquest of Mexico": https://en.wikipedia.org/wiki/Historia_verdadera_de_la_conqu.... A beautiful book in which I learned all of the above. I seem to remember Castillo himself attributed the military dominance of the Spaniards to their modern equipment and horses. My impression that this narrative is perhaps not fully accurate comes from other sources- here and there.

[4] https://en.wikipedia.org/wiki/Battle_of_Isandlwana

← PreviousPage 2 of 34Next →