They can't accrue knowledge because they stop learning once their training is finished.
They can't accrue knowledge because they stop learning once their training is finished.
The difference is that LLMs we can talk to them when they're in that dead state.
And of course for an LLM this is an implementation detail. One could just as well keep updating the weights of the same model over time. And its being done, it's called "continual learning". LoRA is also a way of doing that.
In training they get feedback. Out of training, not so much.
Hard problem
So? We also have the exact same problem, and no solution that covers all facts, not even the most basic ones.
So them having this problem would be either neutral or supportive of the idea they're intelligent, not refuting it.
> Nothing about the conception of knowledge as "justified true belief" implies that machines can't accrue knowledge.
Even if the LLMs could adjust their weights in response to knowledge that they encountered post-training, they would need to make judgements about what is "true" so that they can only add "justified true beliefs" to their weights.
I agree that this is also a problem humans have, and we do really badly at it because we tend to weight social conformance more than factual accuracy.
And yes, I agree that this problem bears no relation to the question of whether they're intelligent, or even sentient. I was answering a different question.