Will AI pass the Turing test by 2029 Jan 1? (Market on Kapor vs. Kurzweil bet)
manifold.markets
manifold.markets
It's not that hard today to find someone who has chatted with a language model and come out with the impression it is a person. The Replika e-friend service is in this grey area, too. People have claimed to fall in love with their virtual friends. I see no reason to doubt their claims. And I think doing that requires projecting human-like qualities on the AI it does not have. I.e., being convinced on some level it really is a person. Though I'm sure some might disagree with that interpretation.
Are these systems not, in effect, passing the Turing Test? At least with some people?
Based on my use of ChatGPT, I believe I personally could be fooled for a significant amount of time, by a system along those lines, one designed to be a little more informal and conversational, with fewer taboo areas. I worry a bit that this will become widespread. That many people will become convinced AIs are sentient thinking beings, because they're just so incredibly good at pretending to be.
[1] https://www.washingtonpost.com/technology/2022/06/11/google-...
That seems like a long winded way of saying it hasn’t passed. The details are quite important in the actual Turing test; if the standard was fooling anyone at any time, then even ELIZA could pass the Turing test.
> I believe that in about fifty years’ time it will be possible to programme computers, with a storage capacity of about 109, to make them play the imitation game so well that an average interrogator will not have more than 70 percent chance of making the right identification after five minutes of questioning. … I believe that at the end of the century the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted.
The standard is more than 70% odds of detecting a fake. If you did below 50% it would be weird because if you were more likely to think a robot is a human than an actual human, you'd just flip your prediction and be above 50%
[1]: https://en.wikipedia.org/wiki/Turing_test#Imitation_game [2]: https://longbets.org/1/#adjudication_terms
The AI will say it’s not appropriate to discuss. Boom, failed.
Or at least, such has been the stated reason of various friends I know IRL who disappeared from social media.
You don't notice them online because they went silent.
The actual discussions I remember from the factory job I did in a summer holiday during my A-levels? (Paraphrased) "I bought a plasma TV for my son" "How old is he?" "Two" and "Dave maxed out all his credit cards, about ten grand" "Tsk, he's never going to be able to pay that off".
I don't think I'm an AI.
He understood and wasn't put off by that at all, by the way. He took it how I intended it: the workplace isn't where we should have charged debates.
Perhaps it would help to state why you think the Turing test isn't good. I think, while it has some charm and poses a considerable challenge to the industry, it is unsuitable in meeting its goal. Turing underestimated how easily humans are being fooled.
No I think that's his point. Humans are actually quite stupid so it's not difficult for a machine to emulate one.
It reminds me of a joke from a fictious park ranger about how hard it is to design a trash can because the dumbest tourists are dumber than the smartest bears.
Turing didn't really intend it to be a real test. It was more of a thought experiment. The reason it's a poor test is because it's so subjective. Whether or not a computer can fool a human depends as much on the human as on the computer.
It's spectacularly short-sighted, in my opinion, to assume that we won't make progress.
Also, some of the prompted or fine-tuned LLMs today are actually very close.