> I'll admit that I haven't even figured out what it means for anything to "know" something.
I think that a core part of what it means to "know" something, is also an understanding of "not knowing". If you provide ChatGPT with insufficient data, it doesn't ask you to clarify anything to fill in the dots or try to eliminate a possible misunderstanding. It just, as you nicely put it, completes the sentence as best it can.
Ask a curious human a logical question or puzzle, and they'll often reply with a bunch of follow ups to fix what they assume to be a lack of knowing.