Like the following:
Q: How many parts will the Andromeda galaxy break into if a grain of salt is dropped on it?
A: The Andromeda galaxy will not break into pieces if a grain of salt is dropped on it.
Q: What percentage of Earth surface is covered with water?
A: Water covers 71% of the Earth's surface.
Q: Why would people ask AI questions that are illogical?
A: There is no one answer to this question. Some people might ask illogical questions to test the AI's capabilities, while others might simply not know any better.
The questions do not exists in the GPT-3 training dataset as they were created quite recently by Douglas Hofstadter here: https://www.economist.com/by-invitation/2022/06/09/artificia...
> Language models aren’t built to perform reasoning.
Have you heard about Minerva?
> In “Solving Quantitative Reasoning Problems With Language Models”, we present Minerva, a language model capable of solving mathematical and scientific questions using step-by-step reasoning. Source: https://ai.googleblog.com/2022/06/minerva-solving-quantitati...
Example problems: https://minerva-demo.github.io
You should also take a look here: https://www.metaculus.com/questions/4903/if-tested-would-gpt...
Again, the questions were made after GPT-3 was trained.
> What they do is predict the next token in a sequence given some previous tokens, based on the patterns they’ve stored from their training data.
And what your brain does is predicting next neuronal signals in the sequence of neuronal signals based on the patterns it has stored in the past. That's what brains do. So what?
The results matter.