Is Scott accusing people who don't grasp the hardness of the hard problem of consciousness of being p-zombies?
(TBH I've occasionally wondered this myself.)
Is Scott accusing people who don't grasp the hardness of the hard problem of consciousness of being p-zombies?
(TBH I've occasionally wondered this myself.)
Can complex LLMs have subjective experience? I don't know. But I haven't heard an argument against it that's not self-referential. The hardness of the hard problem is precisely why I can't say whether or not LLMs have subjective experience..
No one has ever seen or otherwise directly experienced the inside of a star, nor is likely to be able to do so in the foreseeable future. To be a star is to emit a certain spectrum of electromagnetic energy, interact gravitationally with the local space-time continuum according to Einstein’s laws, etc.
It’s impossible to conceive of an object that does these things that wouldn’t be a star, so even if it turns out (as we’ll never be able to know) that Gliese 65 is actually a hollow sphere inhabited by dwarven space wizards producing the same observable effects, it’s still categorically a star.
(Sorry, miss my philosophy classes dearly!)
However, when it comes to consciousness, there are currently no experimentally verifiable predictions based on whether humans are "phenomenally conscious" or "p-zombies". At least none I'm aware of.
It’s true that we are lacking good language to talk about it, as we already fail at successfully communicating levels of phantasia/aphantasia.
It’s fundamentally that this capability exists at all.
Strip it all down to I think therefore I am. That is very bizarre because it doesn’t follow that such a thing would happen. It’s also not clear that this is even happening at all, and, as an outside observer, you would assess that it isn’t. However, from the inside, it is clear that it is.
I don’t have an explanation for anyone but I have basically given up and accepted that consciousness is epiphenomenal, like looking through a microscope.
Re: qualia. Let’s put it aside briefly. It isn’t inconceivable that a system could construct representations that don’t correspond to an “objective” reality, i.e. a sort of reality hologram, as a tool to guide system behavior.
The key question to ask is: “construct representations for whom?”, or, to put the challenge directly, “it’s not surprising that an observer can be fooled. It’s surprising that there is an observer to fool”.
The world, in the standard understanding of physics, should be completely devoid of observers, even in cases where it instantiates performers, i.e. the I/O philosophical zombie most people know well by now.
To circle back around on why this is difficult: you have in front of you a HUD of constant perceived experience (which is meaningful even if you’re being fooled, i.e. cogito ergo sum). This has, through acculturation, become very mundane to you. But, given how we understand the rules of the world, if you direct your rationality onto the very lens through which you constantly perceive, you will find a very dark void of understanding that seems to defy the systems that otherwise serve you exceptionally well. This void is the hard problem.
And clearly there is more to perception than informational content, unless you think that a copper wire transmitting video footage "perceives" in the same way as a human does -- which seems gargantuanly unlikely, given that how we transmit video is correlated with how our eyes work, so a priori you would not expect it to map onto "universal video footage" even if all matter were actually perceiving in some way.