And here is a great example of the problem.
An LLM doesn’t make decisions. It generates text that plausibly looks like it made a decision, when prompted with the right text.
An LLM doesn’t make decisions. It generates text that plausibly looks like it made a decision, when prompted with the right text.
What the “LLMs don’t reason like we humans” crowd is missing is that we humans actually don’t reason as much as we would like to believe[0].
It’s not that LLMs are perfect or rational or flawless… it’s that their gaps in these areas aren’t atypical for humans. Saying “but they don’t truly understand things like we do” betrays a lack of understanding of humans, not LLMs.
0. https://home.csulb.edu/~cwallis/382/readings/482/nisbett%20s...
I don't think there's much of a difference in practise though.