Something that’s lost in these arguments a lot is that you can often get large models to cough up an exact sample from their training set. It’s fair to say that a human cannot do that to the degree a model can.