Intuitive as Statistics is simply one of the many tools we humans use to tackle difficult problems, but definitely not the only one.
Intuitive as Statistics is simply one of the many tools we humans use to tackle difficult problems, but definitely not the only one.
Why would you say should you not be killed by advanced robo-zombie AI?
It will be up to the AI to decide.
That's why we think it could be a problem (for us) if the AI to had the advantage on us...
Our thinking: "Great, we've made this 100x as smart as us AI, even gave it a robot body! Imagine how helpful it will be to us".
AI thinking: "Hmm, those pesky creatures think that I'm kind of their servant because they created me? They're like ants to me. I shall crush them and go on with my plans for conquering the universe".
At that point, further "capability upgrades" may be things you can apply to both systems.
We might have a global maximum of tech we can achieve with our brain capacity that does not including building brain-level intelligence. Not because it's some special taboo/limit, maybe just because it's too high a barrier.
(Or e.g. at best we could replicate it with organic matter, e.g. grow brain cells, tissues etc, but then it won't be as potentially speedy/efficient as computer AI either).
We may not be able to create an AI that's as intelligent as us, but we can create a rudimentary AI that can then make itself smarter as time goes by (and since it can be practically immortal it would have a lot of time to learn) and which can be easily duplicated later.
Downside is we probably won't know what it's actually thinking and what it will do...