>>> Computers [...] cannot pass simple tests of consciousness that a mouse can
>>Like what?
>Vision, for one. Also, running.
Um, ever heard of a digital camera? Or if you mean interpreting images, guessing what, they can do that too. Computer vision is a subfield of AI (arguably; I believe some say it's signal processing). Also, blind people are still conscious, so...
And running? Sorry, I hate to take this tone, but WTF are you talking about? Robots can run, and running has nothing to do with consciousness.
>>If they aren't computing, then what are they doing? You're looking down into the dualism abyss...
>I don't think dualism is what he was thinking of, but rather Searle's Chinese Room argument. Coming from a CS-heavy Philosophy-light background, it took me a long time to wrap my mind around what Searle was saying there, but it's a pretty solid point nonetheless. The best way I've found to explain it in CS terms is that while theoretically, intelligence could be modeled using Turing machines, in practice, we will never have a machine fast enough to do so.
You've totally missed the point of the Chinese Room. The point is that something can appear to understand without actually doing anything we'd call understanding. In other words, ~Ax(OutwardlyIntelligent(x) -> ActuallyIntelligent(x)). It's an argument against the sufficiency of the Turing Test, that's it.
And saying we'll never have a machine fast enough? The only limit on the speed of computation is the speed of light (and the physical size of the universe limits parallelization). But these values also bound our brains. In fact, iirc neurons are actually pretty slow relative to transistors.
>>When I make a decision I consult my values and my goals and attempt to make the decision that gets me closest to my goals without compromising my values
>We have no idea how you or I make decisions, and the notion that we can intuit how decisions are made is a huge road block in even beginning to think about decision-making. Lakoff, among others, does a great job explaining why "values", "goals", and "morals" are simply justifications we create after we've made a decision.
Okay, maybe my deconstruction is correct and maybe it isn't. Whatever. Unless you can explain to me why no such deconstruction is possible, I have no reason to accept that deciding is not computation. In other words, if it's not computation, then what is it?
>> And what makes you think we couldn't build a biological computer
>We can, and we should - but let's agree that it won't be a Turing machine.
Of course it won't. It will be less powerful, because Turing machines have infinite memory and the universe is finite. It'll be a DFA, just like all current computers.