Information Is Physics
cacm.acm.org
cacm.acm.org
Nor created.
I wonder if it will be possible to eventually compute without abstractions, directly on the substrate of the universe. Though that might be equivalent to real magic ;)
Are you asking if nature can be coaxed into doing it in a few seconds or a day? Or maybe you are not bothered about time and want to drop in that seed and grow a chair? The answer is probably yes to both. It will just take some time to get there. I don't think quantum computing will be required but who knows...
I agree that there is no need to bring quantum computing into the discussions, but it is higher on the efficient computing scale. It also requires a lot of effort to come up with programs that make sense, and they use more of natural phenomena (superposition, entanglement, etc) compared to classical computers. It’s something to look at for inspiration, at least?
If you don't mind giving the tree a little guidance as it grows: https://en.wikipedia.org/wiki/Tree_shaping
Also, it is now believed that the Margolus-Levitin theorem puts a lower bound on energy even on reversible computations.
https://advances.sciencemag.org/content/2/3/e1501492
Even in those experiments, there are scenarios where energy is recovered during the erasure of the bit. Although the number of experiments is large enough to recover the k_b T ln(2) expected value.
I wish I knew how to catalog/index my assumption/belief set, so I could scrub it down for unverified sub-assumptions from time-to-time. I'm happy to update them, when they are proven wrong, but I don't know how to do this methodically and as a result, my brain fills up with crap. And then I can't trust my own glib reasoning, and then I have to be methodical for anything I need to think through, and that slows me down. And I hate that.
https://www.amazon.com/When-Computers-Human-David-Grier/dp/0...
I know that others will hold to the idea that they are and could be, but to me that renders us as zombies, and that isn't satisfactory in the sense that while a zombie that acts like a real person would be evolutionary fit, I see no reason why the zombie should believe it has free will, or could, and yet I do.
https://www.sciencemag.org/news/2014/08/underground-experime...
Well ... yes, yes they did.
Pretty fascinating, if light, overview of what's involved in neutron detection. A case of understanding theoretical models (causal knowledge), materials, purity and processing, conversion processes (neutrino interaction -> light -> photodetector), statistics, and ultimately, a view of what was happenning inside the solar core eight minutes ago, events which won't manifest on the solar surface for another 100,000 years.
In the quoted example, "direct evidence" from that paper was not necessary to confirm that the other calculations and models match. The achievement presented in that paper was to measure the specific neutrino flux, but there were many other measurements before that matched the developed models and weren't less convincing.
It's always good to read more than only journalist's interpretation. Here's from the paper itself:
Eve before "solar neutrinos from secondary processes have been observed, proving the nuclear origin of the Sun’s energy and contributing to the discovery of neutrino oscillations."
Only "those from proton–proton fusion have hitherto eluded direct detection."
https://www.nature.com/articles/nature13702
The paper itself stated that the reactions in the Sun were already proved.
Light is not really understood. It's a wave and a photon, depending on what we need to solve. We incorrectly say light is a "wave", but "wave" is a verb!! I remember thinking this sounded ridiculous when I was in school. You probably did too! We should all go back and redo our assumptions like you say.
The other thing that disappointed me was the explanation of why magnets attract/repel. (Do you remember your feeling about it? Did your innocent child mind reject the explanation?)
https://en.wikipedia.org/wiki/Thermal_physics
For a computation focused example, see Schneier's essay on strength of a 256-bit symmetric cipher:
https://www.schneier.com/blog/archives/2009/09/the_doghouse_...
Edit for completeness: rest energy converts to mass as follows: E = m*c^2
https://en.wikipedia.org/wiki/Self-organization
Forms can be quantified by the entropy with respect to its component parts -- generally, the more ordered, the less entropy. Constructing things broadly corresponds to reducing the entropy of the set of configurations of the components.
For example, constructor theory "explains" why life exists. Their argument is as follows (condensing 20 pages of vague equation-free words into a few sentences): first assume that there exists a constructor for life. Such a constructor is defined to be an object that can create new life. This leads to the creation of more life. Therefore life exists.
I was so shocked by this that I reread their paper three times before concluding their argument really was that vacuous. Their physics-related stuff is similar: assume the desired conclusion, then pretend you've derived it by adding the vague term "constructor" everywhere. (To derive F = ma... assume F is a constructor for ma!) It's so content-free I literally can't find anything specific to criticize. But they keep getting press by making more and more outrageous claims.
The fact that tens of thousands of curious people around the world have been duped into thinking that it is on par with ideas that actually have content proves the absolute bankruptcy of science communication. It is also a warning to avoid blind trust in past credentials.
Indeed. A thing is initially more interesting if the author has past contributions of worth, but historical performance should never lead to blind faith about claims. Always remember Linus Pauling’s irrational infatuation with vitamin C.
Well, if it's a "new mode of explanation", then the baseline expectation is that it doesn't add anything to all existing explanations of physics. The point of it would be to somehow allow explanations of things that were unexplainable before...
I mean, if you have a new way of explaining things, you have to derive all of the things we already know are true.
Edit:
The "Outline" at the bottom of the page doesn't sound like a profound new way of understanding the universe; it makes my bs meter twitch, but I don't see anything that provides a definitive reason to consider it all null.
love this phrase.
Just linked this on a similar information theory thread [1] (glad it's so popular on HN right now!)
Physics is information: Energy can be viewed as information. Some researchers investigate the notion of "it from bit": that all of physical reality is the result, and derives its essence, from yes-no bit strings/Turing programs. This view offers answers to the limits of physical inference machines such as the human brain. It leads to the field of digital physics, offering a notion of a computational universe, applying our knowledge of algorithmic information theory, such as the distribution of random strings, to physical reality.
Information Theory part 12: Information Entropy (Claude Shannon's formula) https://www.youtube.com/watch?v=R4OlXb9aTvQ
Those discussions might involve interesting physics, but it's certainly clouded in very poorly chosen and confusion-inducing terminology.
But even then, there are questions. Are math and logic made of physical stuff? What about causality or laws of nature? And what of universals or possible worlds or counterfactuals? If those exist, are they physical?
And then there's consciousness, and the ideas we have about the world, of which the study of physics is but one domain (containing concepts of energy, mass, fields, laws, information). Are these ideas physical?
What about the debate over the proper interpretation of quantum mechanics? Is that physical or philosophical? Is philosophy physics?
You quickly run into problems when you say that everything is domain X, because then you have to justify lumping everything into that category.
And the idea that everything is physics is open for debate, so clearly not everyone agrees that it is true by definition. Most things in philosophy don't get a free pass by virtue of definition, because people aren't going to usually agree to go along with said definition. Instead, they will want to ask what it means for everything to be physical.
As for your other points, I'm familiar with the debates on physicalism in their various forms. I just believe most of them are elaborate semantic games with very little actual content.
That people will ask what it means for everything (or anything) to be physical is precisely my point — stating that "information is physics" is a vague and (in my view) probably empty/tautological statement if you don't explain what you mean by that more precisely.
See e.g. Bayesian Brain and Universal Darwinism
[1] https://aeon.co/essays/your-brain-does-not-process-informati...
And even if we don't have the correct algorithms in sight today, there is every reason to believe that whatever processes are occurring in our brains and bodies, can indeed be simulated and replicated virtually.
The only way to argue against this idea is to claim that there is some special magical non-material aspect to our existence... which no article or neuroscience education has yet demonstrated.
True, but there are some pretty interesting ideas out there. I'm going have to start putting together a list of articles. From the proof that if we have free will, so do particles to some extent. To the notion that quantum computation may happen in the brain. Not saying I believe these things, but the people behind them are pretty smart.
The question remains, what reason do we have to believe that only a living brain, and not a silicon analogue, can tap into those features of reality?
The trap is to think about the brain in terms of things we find impressive, and about things we find impressive as being like brains somehow. Therefore analogies to steam engines, computers and deep learning. And these analogies have always turned out to be silly.
BUT: at least I think we are far from it. Very far. In the sense that we don't need more computing power of the current approaches to get e.g. AGI, we need radically new ones. And I actually don't see why this would be opposed to more neuroscience education, instead of excitement for cool but still quite limited models, and why this would be pretending that there is some "special magical non-material aspect to our existence"
How much can you compress the essential structure and complexity of an intelligent brain? It is an open question, but if in the end you can not compress it "enough", it does not have much practical consequences of it being also theoretically a mathematical object. And on top of that: we already know how to make new ones...
Very tiny animal life shows what we would consider intelligent behavior. There is no particular reason to believe that evolution has even come close to size optimization that intelligence can be reduced in, as there are a large number of other dimensions it is working on at the same time, survival being the big one.
The article, however, is rubbish. As psychologist, I cringed throughout. It is a blurr of half-baked ideas and ill-understood controversies from cognitive science. The author manages to write an entire article about information at its core without ever properly defining information, not to speak of representation. In the sense of Shannon, or course neurons are channels transmitting information. What else would they do?
And of course we can decode that information even from the outside, even down to discrete processing stages during the execution of mental tasks (https://onlinelibrary.wiley.com/doi/epdf/10.1111/ejn.13817). And if there are truely no representations in the brain, as the author states, how do we plan for future events that are far beyond the horizon? And even if you reject all that, there is DNA in the brain that is literally information and expressed (decoded and made into protein) ALL THE TIME.
Regarding cognition, the good Mr. Epstein has not grasped the difference between computers and computability. I don't think anybody is looking for silicon in the brain. The smart people are asking how it is possible for a complex system to operate in a complex world without an outside unit directing their behavior. They ask "How how can the human mind occur in the physical universe" (http://act-r.psy.cmu.edu/?post_type=publications&p=14305)? How is it that we can do the things we do? How do we set goals, plan steps to achieve them, and choose the right actions for implementation?
I get where you are coming from and I agree with you regarding a dangerous misunderstanding of AI, especially ML. But this article is not helping putting things in perspective. I am willing, however, to concede one point to Mr. Epstein: His brain is dearly lacking information, representation, algorithms, or any such marker usually signifying intelligent life.
Regarding the questions you addressed, my suspicion is that the brain's primary trick is to model the organism and the environment. Planning ahead, reasoning and synthesizing knowledge can all happen if you can do that. I'd argue (and of course I'm biased) that control theory is probably a better place to start thinking about the brain, in that light, insofar as building models of the world is important.
If you want to be successful in a complex world, survive, replicate, you will profite massively if you know what is going on around you better than that other thing that wants to eat you. If you can grasp the structure of the physical world and predict its changes, you will come out on top. Information processing is an evolutionary necessity, because we are grounded in a physical world. Information is the successful way to deal with the world, because it gives the organism a choice.
Control theory is great if you want to describe real valued in- and outputs and their relationship over time. Like throwing a ball. But at some point we need to become discreet and abstract the real valued domain of space and time into symbols.
Jaron Lanier argues that computers and computation are cultural. Why give them a special ontological status? Yeah, we can think of the universe as computational or informational. We can also think of it as mathematical, mental or just whatever physics posits (fields, strings, higher dimensions, etc). Whatever the case, when someone like the article in the OP states that reality is X, then an ontological claim is being made. Its metaphysics.
One could instead argue that the world just is itself, and anything we say about it is our human model or best approximation. Which would be a combination of realism (the world itself) and idealism (how we make sense of it). Then it's just a matter of not mistaking the map for the territory. Instead of saying that the brain or the universe is X, we say that X is our best current map for Y. We don't say that London is a map. That would be making a category error.
Less load/process/store of absolute data and more like natural processes such as the process of erosion creating rivers. The analogy of the environment as a "lock" and organisms are just the most fit "keys" to success in particular environment.
So the computer analogy is bad because organisms are more a matrix of interactions, feedbacks and responses that work well enough, but dont follow a "logical" design. This can be replicated within a computer easily and the result is evolutionary computation & hardware, genetic algorithms and evolutionary neural networks. The problem in understanding the result of evolutionary systems is that they're blind to design and only respond to fitness and therefore create systems that are so tightly coupled it's a quest to understand how the model even works.
So the article is suggesting we shouldn't apply human design principles to evolved solutions. Perhaps we need some kind of "messy science" to make sense of it all.
Going forward, machine learning running evolutionary algorithms on neural networks should be able to produce sufficiently incomprehensibility for us to be studying our own inventions for years to come.
With no apologies to the UNIX metaphor of "everything is a file", my favorite starting point for [pretending at] explaining intelligence/understanding/recognition has long been "everything is a metaphor" ;)