Wtf? It just did. Have you read the paper? Wake up.
Wtf? It just did. Have you read the paper? Wake up.
What's the difference?
Where are you getting this?
From the excerpt:
"We set out to investigate whether GPT-3.5 (Codex and InstructGPT) can be applied to answer and reason about difficult real-world-based questions"
I am going to be repeating that ChatGPT cannot classify popular animals correctly as many times as needed. I've been using the app daily and it's quite frequently factually wrong about many other topics, too (for example, programming, or history).
[1] Can large language models reason about medical questions? https://arxiv.org/abs/2212.13138
More importantly, simply regurgitating what experts say (within-class performance) isn't interesting because it's not going to convince anybody that it's going to make good decisions.