Biggest problem in this area, is nobody really knows what "consciousness" means (or if they are completely certain, then they also disagree with someone else who is also completely certain and/or deny the logical consequences of that definition).
And yet, both the binary logic software and the playback device following the script are completely unaware of what they are doing or why. In terms of consciousness, they are as dumb as a hammer.
In other words, any "consciousness" in this is strictly limited to the author of the software and those who interpret the results. Otherwise, on it's own, it has no impact on reality. An ant comes way closer to exhibiting self awareness and consciousness.
Indeed, this lack of awareness of (and lack of regard for) the lower level of our nature, is why we were very happy to invent birth control, and why the people who get upset about the existence of it are seen by the rest of us as a bit odd.
[0] Depends what you count as a human/person/creature with consciousness, which is of course the point of this thread. Yay for blurry lines!
Our genome is not a script --- more like a blueprint.
Once construction is finished, the thoughts and actions of your mind/body are not "scripted" --- unless you *believe* in pre-determination.
If you don't want to count the data flow in a human brain as "scripted", you can't count the data flow in an artificial neural network as scripted; if you do count the ANN as scripted, then you should also count brains as such.
Current AI are, it is worth pointing out, less complex than a human brain: GPT-3 is appropriately the same number of parameters as a rat has synapses, while DALL•E 2 is approximately a honey bee. But the argument you're making has not yet touched scale.
Can it diagnose my car engine? It seems to be idling rough and it's using too much gas. Does the throttle body need cleaning or maybe one of the coil packs is failing?
Probably.
My free credit has run out and I've not gotten around to setting up a payment method for more credit, but this kind of random question is the kind of thing it's surprisingly good at.
Does it ever object to answering a question? What does it think about in it's spare time? Is it scared someone will turn it off?
The distinction here tends to highlight the difference between consciousness and programming.
Most humans would fail this standard. (Hence the memes "Never read the comments!" and "Eternal September" and widespread beliefs in paranormal and so on).
The (surprising to me) difference is that GPT-3 generally does a bit better than, e.g. Hollywood script writers when facing similar prompts.
This surprising quality is why GPT-3 led to GitHub Copilot.
https://www.mensjournal.com/adventure/people-asked-to-draw-b...
Would the Roomba be conscious if it had a dust sensor? Then it would know that the result cleans the floor.
Are you a robot? Speaking strictly for myself, my brain does not follow a script. I normally operate on my own --- like when I formulated this reply to you.
I think this is at risk of becoming a debate over the word "script". Is it a matter of complexity? Is GPT-3 a script? Is Windows a script, even though it has more bytes of behavioral code than the GPT-3 weights? Will the Roomba be conscious if I replace its programming with a neural network, even if it behaves the same way? What if I add code to randomly vary its behavior? What if I add code to learn at runtime, considering that the learning code is still perfectly static?
You have my sympathy.
What is a thought, if not a pattern of information that in humans is embodied in the energy flowing though our neurons, and which finds an analogy in the information flow though an artificial neural network?
Are human thoughts really any more independent than any self-learning process that happens to be implemented in silicon? What makes the tiny warm bags of chemicals that are our cells, special?
> self awareness
Can you define this in a way that it simultaneously (1) is something that humans do actually have, and (2) is not trivially accomplished by giving an AI access to its own state, whether by internal feedback loops in a neutral net, by embodiment in a real or simulated environment where it can sense its own embodiment as another agent in that environment, or by other similar means?
(Edit: also simultaneously with (3), no references to the word "consciousness")
> motivation
Internal states within an agent which create a disposition to engage in specific actions?
I definitely don't need much to pass that test: both (original 1993) Doom and bacterial cells demonstrate this.
Yes. It's called "creativity" and "independent thought" --- not programming.
What makes the tiny warm bags of chemicals that are our cells, special?
Maybe quantum physics? This remains to be fully answered but their "specialness" compared to silicon/sand is not in doubt.
The AI under discussion here are no more programmed than you or me. The architecture of our brains comes from our DNA, an artificial neutral net from hyperparameters, but in both cases the interesting stuff is learned. The billions of parameters in GPT-3 and DALL•E 2 etc. are beyond the means of humans to program.
Edit:
> Maybe quantum physics? This remains to be answered but their "specialness" compared to silicon is not in doubt.
Quantum computers exist. They are no more animate than classical computers. Would you expect to change your mind if you saw an AI running on a quantum computer, or would you expect to continue to insist that brains are special?
Edit edit:
Can you define "creativity" without reference to any of the other things you're trying to use to define consciousness?
Ah, the standard question-begging ontology backed by nothing more than arguments from incredulity.
(1) "Animate vs. inanimate" is a separate axis to «every defining feature you've just used for consciousness» vs. «the absence of that»
(2) Inanimate AI can trivially alter their surroundings, all I have to do is say "Alexa, Badezimmer zehn Prozent". And this isn't an AI that I hold in high regard or consider to be conscious or anything like that — I have to ask three times while getting increasingly annoyed, because for some reason Alexa can't hear me properly and the first response is usually "Ich kann nicht Badezimmer auf Spotify finden" even though we don't have Spotify.
Still alters it's surroundings, though.
> It's just one of the things that inanimate objects can't do --- they can't alter their surroundings
And given that you wrote that as a response to the question:
> What's consciousness have to do with impact on reality?
Then you must logically say that it is.
Fortunately I don't have to claim such a belief for myself, because I said earlier:
> nobody really knows what "consciousness" means (or if they are completely certain, then they also disagree with someone else who is also completely certain and/or deny the logical consequences of that definition).
With specific emphasis on "deny the logical consequences of that definition".
Ah well. Perhaps one day, we'll have an AI that can tell us what consciousness is without repeating all the mistakes and pitfalls that humans make when trying to philosophise about this topic.
Consciousness is the perception of self, which is the result of an information model on self built by the brain from a) the external experiences of the entity, b) the internal experiences of the entity.
Personally I find the above definition 'good enough' for all purposes. Are there any disagreements on the above?
In your specific case, for example, there are non-trivial issues with the words "perception", "self", and "internal experiences".
So instead of ben_w saying
>nobody really knows what "consciousness" means
you just changed it to
>nobody really knows what "internal experiences" means
So then we haven't really gained anything in terms of being able to do rigorous science w.r.t. consciousness (except for some vague pointers, which might be valuable nonetheless).
An additional problem is that "a camera pointed at a TV displaying the output of that camera" meets that definition of consciousness.
I don't think that setup should be counted as conscious.
It transforms code from its training dataset in a sufficiently vague and exciting way. That's not all of what writing is.
Any sufficiently advanced technology is indistinguishable from magic.
For the purposes of this level of the thread, I don't see how it matters what's going on under the hood, just that it can output code when prompted?
(I'm pretty directly saying "consciousness is ill defined", after all).
And that is what I call "religious thinking" or "mysticism".
That's the entire point I was making. ML isn't intelligence. It's data transformation. But calling it "artificial intelligence" has become something of a religion to itself. Just like with any other religion, belief demands ignorance.
You know Searle's Chinese Room? I'd have agreed with you if you'd just written that ML is that room.
I'm also saying fairly explicitly that right now it's impossible (no possibility of Popperian falsifiability) to say if an artificial neural net is or isn't conscious, because we don't know what that word really means.
But, the well-defined common definitions of intelligence are: abstraction (trivial CS), logic (fundamental), learning (all ML is this), reasoning and critical thinking (appears to be demonstrable but might be a Clever Hands illusion), planning (university courses cover this before they get to ML), and problem solving (widely demonstrated in multiple fields).
Again, I'm specifically avoiding the ill-defined parts of the definition. If you want to have a go at defining them, by all means, have fun — but my experience has thus far been that every definition falls into a few categories:
(1) recursive meaninglessness (think "intelligence is consciousness, consciousness is intelligence")
(2) things which humans fail at (think of a test of intelligence which, if applied to a human, would be equivalent to claiming a human born without eyes wound really know what the subjective difference between red and green is)
(3) things which computers can do trivially (sometimes even finite state machines, let alone ML systems)
So yeah, not sure why you think "intelligence" is religious and why textual output isn't "writing".
Confusion can't take the place of knowledge.
We don't know how much of a replacement for intelligence we have created with ML, but we can be certain it isn't a complete one. No matter how difficult it is to articulate, the difference between ML and intelligence is vast and obvious.