Ie we will be able to describe how a function of `add(1,2)` is most clearly definitely not intelligent. We will understand the internal makeup of these neurons better, the whole system will be deterministic and understood - just a very large `add(1,2)` .. so it's definitely not intelligent, of course.
Yet it will still produce output that is fully and truly turing-proof. If you let it run, it retains, stores, "behaves", etc. It's clearly just `add(1,2)` in a loop after all.. we will understand it so well that it's obviously just a trick of our mind that it seems real.
The conclusion in that space will not be one of the machine .. but of us. If we can't tell it apart from us.. and if we know it is most definitely not alive or even mysterious.. what does that say about us? The existential crisis will be neat.
Less than people think. We know that being a biological system differentiates us. If intelligent systems tend to converge where language is concerned, so be it. It doesn't mean the AI warrants any special consideration. It's still a tool.
That concepts like "consciousness," "free will," and "qualia" are nebulous precisely because they were invented by us to describe things we don't understand yet we feel obligated to insist are special and unique characteristics of our identity.
"Can you pay attention to this part of your experience?" is a very black-and-white, non-nebulous question with an easy yes or no answer. Not sure what you're reading into this.
Consider a video camera. It seems like it is a consuming a "stream of experiences". But most people wouldn't consider it it conscious. Why not under your definition? It works when on, and is stops when turned off. Black and white. But clearly we are missing some nuance in the details. Maybe we also require some interpretation of the experiences? I can spin a convolutional neural net that identify objects within a video: interpretation. Does that make it conscious? No? Then we need something else to define it. Maybe response to stimuli? We can program machines for that, but then also things like fire respond to environment interactions too. And so on. It really isn't black and white after all.
What does "pay attention" mean?
I've come to suspect that a habit of using the passive voice when discussing these phenomna contributes immensely to their ongoing currency. Steering away from this by asking questions like, "_who_ or _what_ is attending to/experiencing the stream?" may be a useful way to ground these statements in material terms.
Consciousness, on the other hand, boils down to what gives rise to the sensation of self-awareness, and what that sensation actually is, and it's not a given that requires any form of dualism (or that any form of dualism would solve the question at all) or that a strict materialist world can't involve self awareness.
For what we know, self-awareness could be a property of matter itself, and the only thing different between "conscious" and "non-conscious" is getting to a level of sufficient reasoning-ability to actually be able to express it.
Nova/PBS recently did a number of episodes on the number of tricks your brain is playing on your at anytime. Once you start seeing the shortcuts the brain takes in action the entire process is far less magical.
Because it's still equally nebulous.
No, its not.
Its the quality of “experiencing”.
Which is impossible to define in objective terms; it is the essence of subjectivity on which all other subjectivity rests. It’s not merely “we don’t know how to determine whether an AI or camera has it”, it is categorically impossible to determine if something has it. The popular narrative about which things in the natural world have it has evolved radically over time, but in no case has there been, or could there be, any empirical basis for this; its all just vibes.
And your definition is now circular and can not be used that way.
Hence the claim that the original definitions were nebulous.
Those seem equally nebulous.
> "Free will" means "a feeling that one could've made a different choice"
That doesn't seem like the ordinary definition of the term, either in philosophy or in everyday usage. I would think most people would define "having free will" as not just feeling that one could have made a different choice, but rather it actually being physically possible for a different choice to have been made.
> "qualia" means "specific characteristics of experiences that one can attend to"
I think those are also equally nebulous.
> One need not "insist" on anything to believe they are unique characteristics of our identity.
The insistence is necessary, and invariably comes up. As soon as I say to someone "given your definitions of these concepts, I don't think they exist" they will say "well, I've started with the foregone conclusion that I cannot deny the existence of these things, so either you're plainly wrong, or we need to tweak our definitions and understanding of these things."
They aren't. It's literally happening right now as you read this - a stream of experiences is present. If that is the case, YES it is consciousness, if nothing is happening, NO it is not consciousness. Black and white - literally as non-nebulous as you can get.
We often discuss things that would challenge or overtake us. Hypothetical advanced aliens, artificial AI, etc. However i don't often see pop culture discussing the opposite - us, or even life, being challenged on it's uniqueness. Plus then that leads to all sorts of self-autonomy discussions (which is discussed in pop culture imo).
I dunno, i suspect "people" won't handle it well. Hell, there's entire religion(s) built on the foundation that we're uniquely gifted as a product of being crafted in a gods image. To question us could question god. I find these questions neat, interesting, etc - but socially i suspect it would be troubling, contentious, frightening.