HNHacker News
TopNewBestAskShowJobs

jamesrcole

2,419 karma · joined May 19, 2008

Doing a PhD: The Shared Foundations of Information, Computation, Mathematics, and Semantics: A Causal, Relational Account

https://twitter.com/jamesrcole

Brisbane, Australia.

submissionscomments
jamesrcole··on Available for preorder today, Surface Duo
The idea of it appeals to me. Phone size and weight, and thus portability, yet I can quickly and easily switch to viewing and working with the same details on a larger screen when that'd be useful. That can't be as effectively achieved with two separate devices.
jamesrcole··on Ex-Googler's startup comes out of stealth with simple, clever robot design
Well then you probably have a pretty compelling business opportunity on your hands.
jamesrcole··on Ex-Googler's startup comes out of stealth with simple, clever robot design
> Or you could teach your kids to clean up their toys themselves. [...] To be clear: I am not shifting on you as a parent. I am making fun of owning robots to do the specific things you mentioned.

Most of the specific things they mentioned have nothing to do with being a parent, and also apply to people who do not have children.

jamesrcole··on Ex-Googler's startup comes out of stealth with simple, clever robot design
I think a lot of people would prefer a non-conscious entity to do their cleaning, who has no ability to judge them in any way.
jamesrcole··on Ex-Googler's startup comes out of stealth with simple, clever robot design
I have never hired a cleaner, but I imagine there are also people who are uncomfortable having strangers in their house and handling their things.

I have also heard about people getting cleaners who initially do a good job, but whose work quality degrades over time. You wouldn't have that problem with a robot.

jamesrcole··on Ask HN: What weird or hard problems are you trying to solve?
> Shannon's theory of information doesn't offer a way to tell whether a channel is doing computation or merely transmitting the information -- the mutual information merely characterizes how much information goes across a channel, but is insensitive to any changes to the representation.

In my view, it is more than a change of representation. The computation is using information that might true of something, to produce new information that might be true of something else. I don't see how anything like Shannon's theory could explain how it is able to do this.

> I got inspired by the "integrated information theory" folks -- they have this notion that combining information streams in a nontrivial way is necessary and sufficient for consciousness. I disagree that it's sufficient for consciousness, but it might be sufficient for a definition of information processing or generalized computation.

Ok. I share the same view, that it isn't sufficient for consciousness.

> I don't know what you mean by "the system's conception of meaning" -- which system, and what is a conception of meaning?

The computational system. Consider the case of the human brain, which may be computational. People can understand that some information is about X (say, a particular tree, or the notion of Justice). But it's not just that they know what the information is about, but they understand something of the character of that thing -- of the tree, or of what Justice is like. If the brain is computational, then that would mean that such an understanding was computational (or computational plus bodily interactions with the environment, etc). But that doesn't tell us how it is that computation is able to "embody" an understanding of the character of something. That needs to be explained.

> Here's a link to the paper

Thank you.

Is that the same paper? I notice it has a different title to the one you mentioned above.

jamesrcole··on Ask HN: What weird or hard problems are you trying to solve?
> Ok, so less about the flow and nature of information and more about the semantics.

I'm working on explaining the fundamental nature of information, and arguing that it is fundamentally semantic. I think there's a lot of confusion about what information theory actually tells us. I don't think it actually tells us about the fundamental nature of information. This isn't to detract from its importance, or to say the theory itself is wrong -- I'm saying that the usual interpretation of what it means, regarding information, is flawed.

> Are you familiar with Karl Friston's work on the Free Energy Principle?

Not terribly familiar with it. I watched the video.

I don't think it gets down to the a precise understanding of the fundamentals. I don't think there is a good understanding of the concepts like information and modelling, that it uses. It doesn't seem to provide specific mechanistic explanations of how the phenomena work and how they have their apparent properties.

As a couple of examples, what explanation does it have of how a system may have an understanding of the character of some entity? Where that entity might be something apparently "abstract" or "imaginary"? If the semantics are about mathematical details, what exactly are they about? What are those mathematical details?

But I don't think I can really hope to explain my position here. It requires a lot of explanation, and I'm still working on the explanation.

>> The key to all this is appreciating that, once you see semantics and information processing as a matter of physical processes, you can see that the correct semantics can be necessary for producing a physical outcome.

> I think I understand what you're saying and it touches on some of my own inquiries. A more concrete example, if you have one, might better help align me with where your thoughts are at regarding this.

Imagine a robotic arm that, when a electrical current is sent to it, reaches out and grabs at an area in front of it. If that current happens when there's an object in that position, then the robotic arm will end up picking up the object. If the current happens when there isn't an object in that position, the robotic arm will have picked up nothing. Thus, the semantics of the electrical current has a necessary causal role in the arm picking up the object. And thus we can analyse the causal details to get a concrete understanding of the semantics and its role.

jamesrcole··on Ask HN: What weird or hard problems are you trying to solve?
> We're in need of an information-theoretic definition of computation or information processing

Could you elaborate? It's not clear to me what you mean by that.

> It's clear that there is a relationship between computation and information via Landauer's principle.

Information, in the sense I'm concerned with, is an inherent part of computation. You can't have the latter without the former.

> Semantics: in short, 'meaning' is just a mapping (ie, mutual information) between language and the physical world.

That doesn't explain meaning in the case of imaginary or abstract details, or the system's conception of the meaning.

.

BTW, would I be able to get a copy of that Hopfield paper? I wasn't able to find a copy of it.

jamesrcole··on Ask HN: What weird or hard problems are you trying to solve?
I don't think so, in the sense that it's not concerned with the same kinds of details as information theory (which it is not to say it is incompatible with it), and it provides a set of foundations that are common to information, semantics, mathematics and computation.

As is well known, information theory doesn't deal with the meaning of the messages. As far as information goes, I am primarily concerned with information in the sense of such "messages", and their meaning.

Computation is considered by many to not involve semantics, because it processes information in a "blind, pattern matching" fashion, without regard to its potential meaning. But the sense in which it is semantic does not have to do with its intrinsic characteristics. It it a matter of its "extrinsic" details - how the information states in it relate to details that are (typically) outside of the computation. Seeing the computation as a physical process, processing information "about" details in its environment, highlights this.

The key to all this is appreciating that, once you see semantics and information processing as a matter of physical processes, you can see that the correct semantics can be necessary for producing a physical outcome. So you can analyse how that physical outcome was produced, in order to understand the semantics.

jamesrcole··on Ask HN: What weird or hard problems are you trying to solve?
I believe that computation, mathematics, information and semantics all share the same set of simple foundations. And that the means to understanding these foundation is to look at how physical computational processes use information from their environment, and produce information that is used to make "real world" outcomes happen.

I am working on this at the moment, and no, I don't expect that what I write here will convince anyone. And I don't have any summaries of the work at the moment.

jamesrcole··on Show HN: GIF Directions
Suggestion: allow the creator to control the play speed at specific places in the gif. Eg play it faster along a long stretch of straight road, but then slower when making turns. In first example on the site, I find it difficult to see where that last turn into the diveway happens because it happens so fast.
jamesrcole··on Even if you’re asymptomatic, the coronavirus can do damage
You described the article as a light variation of panic selling, and said that it throws a scary headline on the details to drive clicks. The headline is "Even If You’re Asymptomatic, the Coronavirus Can Do Damage", and regarding the 'ground glass opacities' it says "How big a deal is this? No one’s sure."
jamesrcole··on Even if you’re asymptomatic, the coronavirus can do damage
You’re implying that “common” means “not bad”.
jamesrcole··on I Am Deleting the Blog
Is there any way to verify that this is the person? Obviously, it would be wrong to pin the blame on the wrong person.
jamesrcole··on I Am Deleting the Blog
they've already succeeded in getting the site removed from the internet, and done so with complete impunity.
jamesrcole··on I Am Deleting the Blog
It's just assumed in your comment that this should only be about the media outlet, and that we should ignore the journalist involved.

The problem with people trying to shut down others primarily comes from individuals. Often that's individuals on social media. In this case it's a journalist. These individuals can destroy other people's lives, yet they essentially face zero consequences for doing so.

And each time they succeed, like in this case, they embolden others to do it.

jamesrcole··on I Am Deleting the Blog
Part of the reason people do things like what the journalist did is because they can do so without facing any consequences. There should be disincentives for that kind of behavior. I'm not talking about them being threatened or put at risk. I'm talking about there being consequences for their reputation.
jamesrcole··on I Am Deleting the Blog
I would like to know who the journalist is. Not so they can be threatened or put in danger. But so their reputation can take a hit. Part of the reason people do these things is because they can get away with it without any consequences.
jamesrcole··on Scraping Roger Ebert’s reviews and finding his favorite movies on Amazon Prime
On a tangent: I dream of a web where whenever there are sets of items (eg eberts-great-movies, and movies-on-amazon) you can easily apply set operations (like intersection) on them (so if ‘n’ stands for ‘intersection’, eg eberts-great-movies n movies-on-amazon).

So, in effect if you’re on a site that deals with a set of items, like the amazon prime movies, you can tell the browser to intersect this set with a different set at another URL.

I understand that doing this would require the right ‘infrastructure’ to be in place.

jamesrcole··on Tribalism comes for pandemic science
> the left says "lockdown lockdown lockdown"

of course that hasn’t really been the case over the last week or so.

jamesrcole··on Editors (Vim)
Yes, I am on MacOS. Thanks for the info.
jamesrcole··on Editors (Vim)
Looks like it has. E.g.

- https://medium.com/fast-company/the-mouse-of-the-future-your...

- https://purehost.bath.ac.uk/ws/portalfiles/portal/190368020/...

more https://www.google.com/search?q=eye+tracking+text+editing&oq...

jamesrcole··on Editors (Vim)
I used Vim for a number of years (I'd guess around 10), and for the last year or so I've been using Spacemacs. I think there's so much that's great about both of them, and I'll continue to use one or the other, but geez, there's so many niggling issues with both that can be offputting.

A couple of examples. In Spacemacs, the screen regularly goes blank for a while. Or if I have a file open in Spacemacs, close its window, then rename it in the OS, then reopen it in Spacemacs (by double-clicking it in Finder) it reopens it with it's old name. I'm sure there's a way to avoid this, but the fact that it happens in the first place is the issue.

jamesrcole··on What is emergence?
Entities have state (including position) and ways of interacting with each other. This leads to new state in the next moment, which leads to new state in the moment after, and so on. Thus the more global state affects the future state. There’s nothing mysterious about any of this.

Usually when people make a deal about emergence they’re confusing the map for the territory. They couldn’t predict the overall state evolution just by considering the parts.

They’re thinking of their notion of the generic entity type. But all that’s out there in the territory are the entity instances with their specific state.

The parts can’t exist in a stateless fashion. It’s just that in our heads — the map — we can consider them in that fashion.

jamesrcole··on Simplifier
On mobile the text is very small.
jamesrcole··on Idea Generation
Another means: have really high standards. It’ll make you better at spotting when something ought to be easier to accomplish. You’ll instinctively feel irritated by the fact that it isn’t.
jamesrcole··on HBO Max taking on Netflix with human curation instead of relying on algorithms
Most (all?) of that exclusive content only gets produced because of exclusivity, I’d think. I.e. we get a greater number of shows because of exclusivity.
jamesrcole··on Exiting VIM is hard; sometimes we need to take drastic measures
They might have pressed some keys as soon as they opened Vim causing that message to disappear before they got to read it.

Or they might have been working on a file for hours before they want to quit it, so might not remember.

Or, they might not know how to enter :q. Entering it requires them to be in the right mode.

(I say this as someone who's used Vim for a number of years).

jamesrcole··on Twitch Is Developing Talk Shows and Dating Programs for Gamers
I agree that tends to be problematic. Especially labeling yourself in that way.
jamesrcole··on Twitch Is Developing Talk Shows and Dating Programs for Gamers
I don’t like identifying myself with labels like that. It feels too prescriptive and restricting. I’d prefer to describe what I believe and what I do.

That said, I feel that this usage of “for gamers” is pretty innocuous. I take it to be a shorthand for “this is for people who are really into games”.

← PreviousPage 5 of 34Next →