> But of course it doesn't do that. It's just a way of getting a machine to identify partizan stories that are statistically likely to contain a higher proportion of lies, especially if they are from right-wing sources (Table 1).
I think if a system like this got traction, then like many things academics produce, it will be misconstrued and misused.
> It's really not hard for professional journalists to fact-check partizan articles, and I'd assume the ones hired by Buzzfeed used several well-known fact-checking sites, including Politifact.
You should not assume things like that. And again, if they were just gonna look stuff up on Politifact, why couldn't the researcher do that themselves? It's clear there was a more in-depth process here. I think it is totally fair to say that the process could be a good one even if Buzzfeed is a bad choice of organization to run the process with, but further research would have to bear that out. Because only Buzzfeed was involved, it's impossible for us to determine whether there was a bias in the data because of who produced it.
That is, we can't be sure if that data would be similar if we had, say, the National Review doing fact-checking. That's why we need either (preferably) more than one fact-checking organization, or at least a single but highly neutral one.
> As we know all too well, individuals commonly abrogate the responsibility to understand and analyze sources all by themselves.
Which does not mean we shouldn't be careful about enabling it.
My fear here is the common trope of "X new discovery is an oracle," where we take some interesting tidbit about patterns (in in this case, in linguistics) and decide it is absolute truth or applies everywhere.