Smart CS students were fooled by ELIZA back in the day.
One rapidly realizes how its answers are formed from the questions, and for questions not in a handful of forms, you get one of a very small number of generic responses.
http://www.art.net/studios/hackers/hopkins/Don/text/rms-vs-d...