The New York Times Is Eliminating Its Public Editor Role
huffingtonpost.com
huffingtonpost.com
On the other hand... having Liz Spayd in that role is pointless, so this isn't a loss. The past year has shown us how the New York Times has let false equivalence and the need to sell newspapers to both sides of the aisle has severely damaged the quality of the paper's coverage, and Spayd has continually carried water for this rather than hold the paper to account. I for one am tired of watching the Times sell itself with ads about how the truth is more important than ever and then follow it up with coverage like this:
https://www.nytimes.com/2017/05/03/us/politics/health-care-f...
Where Pelosi saying "Up to 17 million children" is supposed to be misleading because it chooses the high side estimate, when that is exactly what 'up to' means.
Getting rid of the public editor won't make this better, but not having to read a public editor who won't confront this sort of coverage head-on will at least make me a bit less cranky about it.
Two USPS workers. Package label says "Do not bend, fold, mutilate." One says to the other "Doesn't say anything about crumple!"
Har har har.
---
I had high hopes for ACA. I believed the 15% medical loss ratio was the poison pill that would eventually drive insurers out of business, and therefore lead to Medicare for All. For comparison, Medicare's is under 5%, meaning 95 cents for every dollar spent goes to patient care, vs coke and prostitutes for the execs.
Silly me. There's no set of rules that can't be broken, gamed.
So now I'm for dozing it all down and rebuilding with universal coverage, single payer, using the capitation model (reward wellness vs fee for service). No more incrementalism. Just do it.
---
Aside: Mid 2000s, my team created, implemented, supported 5 regional health information exchanges (eg BHIX). It was clear then, to everyone in healthcare IT, that we were pushing cooked noodles across hot pavement. Since then, it's only gotten worse. Overhead continues to grow geometrically, due to things like ICD-10 and meaningful care, without nudging the patient care (outcomes) needle one bit.
I can't explain it.
I just read about cost disease. It seems to explain rising costs, but I don't understand the mechanism, or what to do about it.
https://en.wikipedia.org/wiki/Baumol%27s_cost_disease
And this book blew my mind:
"The Utopia of Rules: On Technology, Stupidity, and the Secret Joys of Bureaucracy"
by David Graeber
Whackamole.
Is this a legit analogy? If so, is either side wrong? How would you handle it, if you were King?
My only notion for healthcare is to change the incentives. Reward wellness vs treat disease.
That's only a recipe for lobbying over what bureaucrats designate "wellness" and "disease".
The best way to fix healthcare is to cut out more middlemen. The person whose health is being cared for (or their loved ones) needs to decide when another $10k scan or $65k pill regimen is worth it compared to using the cash to pay off their (grand)kids' student loans.
If all of this is filtered through insurers, lawyers, and government officials, there is incentives to meet budgets and increase revenue, but there's no win for the actual people and families all this is supposed to be taking care of.
If the doctor can't effectively predict what benefit said scan or pill regimen will provide (50% chance of 10 year life extension,90% chance of 2 years...? not even getting into quality of life), how does the consumer make informed choices? This approach devolves to if you have money you get care, if not, you don't, regardless of need or efficacy. Similar to any other market.
There or some easy decisions to make in medical care (set the broken bone, stop the bleeding), but less so when it comes to areas driving price increases.
Adding layers is potentially problematic, as is removing them. Single payer and no-payer are attractive solutions due to ideological simplicity.
I wonder if a tax funded provision of care rationed similarly to the organ transplant system would be workable...
Most people who are paying that much for pills are retired middle class people trying to stay healthy into old age. Or alive for a few more years. But people should be able to pay for typical levels of healthcare. The fact that this isn't true is a question of economics and employment opportunities, not entirely problem with the "healthcare system" itself.
> There or some easy decisions to make in medical care (set the broken bone, stop the bleeding), but less so when it comes to areas driving price increases.
> Single payer and no-payer are attractive solutions due to ideological simplicity.
I agree with this first sentence more than the second. These decisions are never all that simple. And they are made even more complicated or perverse when you ignore that the best alternative for a bureaucrat (private or public) approving treatments is saying "no" and going home for a Scotch. The best alternative for the patient is saying "yes" and spending $300k and live another year in diapers.
If people were spending their own money, they would also think about:
- grandkids that want to go to college
- underfunded soup kitchens in their neighborhoods
- not reverse mortgaging the family home they wanted to pass down to their loved ones
- going on a "farewell" cruise
And that's just one category of health care decisions. There are more mundane ones like "Should I try the generic treatment for a week to see if it helps? Or should I put $3k into the boutique one and save the hassle?" I wouldn't know how a (even highly qualified, well meaning) bureaucrat in Atlanta would make a better decision than the person getting treated.
What of all the people whose lifespan is cut early by disease? Getting cancer or some other serious disease at a young age just due to sheer dumb luck is less common, but still quite prevalent. Or let's just think about traffic accidents? It's just preposterous to me that people should ever have to worry about sudden illness or injury. If you're looking for bloat and overspending, why not slash the defense budget instead?
> The best alternative for the patient is saying "yes" and spending $300k and live another year in diapers.
Wait, wasn't this exactly what republicans criticized obamacare for? The accusation was that there were "death panels" that would decide whether it's "worth it" to put all that money into that one dying patient, or whether it's better spent elsewhere. So we don't like it when obamacare appears to be doing it, but now that obamacare is gone we want it?
Actual insurance and government welfare programs are for things you can't otherwise save for. Let's not burn straw men, here.
> If you're looking for bloat and overspending, why not slash the defense budget instead?
That's fine, too. But paying for the healthcare of an entire country is far more expensive than even U.S. defense spending. And cutting defense spending doesn't address the structural problems of having party A pay party B to pay party C to produce good health in party D.
> The accusation was that there were "death panels" that would decide whether it's "worth it" to put all that money into that one dying patient, or whether it's better spent elsewhere.
I want the patient to be able to decide (for instance) that another year on the lam from the reaper isn't worth the high price tag. That only really works if the savings goes to what they want: family, charity, community, etc. and not back into the general fund of a government or corporation.
Because health care is complicated, in an idea world, there would be a layer to distill all of the complicated scientific information into simpler, scientifically sound recommendations. In theory, this is what your doctor should do. In practice, this system is currently broken in the United States. It is easy to demonstrate cases of over-treatment in the current medical system. (http://www.newyorker.com/magazine/2015/05/11/overkill-atul-g...).
If the consumer was paying for everything with full price visibility, would this change? I'm not sure. The problem here is a large amount of people would have no idea whether the prescription / test the doctor is requesting is worthwhile or bunk.
In fact, I think some of the over-treatment today is by "by patient request". One reason given for why doctors write antibiotic prescriptions for viral infections (which as we should know is scientifically useless and may in fact be harmful due to the potential of allergic reactions) is to make patients feel better by making it seem like something is being done. (http://ideas.time.com/2012/04/16/why-doctors-uselessly-presc...). The same probably goes for even more expensive cases (MRIs for most back pain cases, for instance).
Think of what we see in the "alternative medicine" market. There may be a few hidden undiscovered gems in that field, but in the majority of cases people pay sometimes a ton of money for what ends up being a rather expensive placebo effect at best (or harmful snake oil at worst). All of this both because medical science is difficult to understand (where glossy marketing is easy to understand), and also because in many cases medical science has unsatisfactory answers for people desperate to be healed.
I'm not saying that knowledgeable bureaucrats are completely correct (ideally the doctor and patient are making the informed decisions together, not the bureaucrats) but I can't see not having some layer that aims to eliminate the current perverse incentives in the system.
So you'd eliminate pharmacy benefit management companies?
https://en.wikipedia.org/wiki/Pharmacy_benefit_management#Li...
Or are you saying eliminate insurers (insurance) altogether?
There's a reason food lobbying groups exist.
> Or are you saying eliminate insurers (insurance) altogether?
I'm not saying there's an easy answer, but as long as all health transactions are paying for one party's health with another party's money, we'll have bad outcomes.
If the problem is that it's expensive to live, then let's talk about that problem (negative income tax credit, minimum income, optimize for cost of living, etc.) instead of trying to bureaucracy (private or public) our way into utopia.
The failure of Republicans to implement an alternative has pretty much guaranteed it.
I don't find that surprising though. I think Obama himself said that ACA was just a start and would have to be revisited. (Citation needed, I know.) What's amazing is just how bad conservatives have been at articulating the free market case for health care and insurance.
He's either the end of the Democrat establishment (the election and post-election hysterics are unheard of in my lifetime), or the end of the Republican establishment (if he crashes and burns as bad as certain circles think he will).
I remember similar things said of their prior ombudsmans (ombudsmen? ombudespersons? ha). I stopped reading NYT when they helped sell Bush's Folly in Iraq, so I don't have a dog in this fight.
I ask because I've been eagerly awaiting the next iteration of journalism. Though I can't guess what that'd look like.
Frederic Filloux (mondaynote.com) has some notions. Mostly how to make it viable.
And I really wanted the Nerd TV 2.0 format experiment to happen (publish all source material as-is, much like we're asking for academics).
And lastly I really wanted the wikipedia model, as envisioned by Clay Shirky in Cognitive Surplus, to become more mainstream, but I don't know why that format isn't replicated more widely.
What does that mean? Are you saying you would prefer the paper take a more hardline stance in favor of one side because you perceive that side to be objectively superior in some manner?
Allowing Kushner to present his spin as neutral is a de facto false equivalence and shifting the 'objective' reality, which other organizations (WaPo) who practice investigative journalism, as opposed to access journalism, refused to allow themselves to be used for.
Also I wonder to what degree the journalists and anchors involved actually believe those things, or they simply know what to sell and do it regardless of their personal convictions in the matter.
If anything it proves that journalism is doing quite well at the NYT, and the narrative of "bias" and "propaganda campaigns" is undermining civil society, and unfairly accusing people doing the best they can and mostly succeeding.
I was replying to gp's comment about Liz Spayd criticizing Times
That's why Trayvon Martin was such a massive story... two polarized, completely entrenched sides battling at it endlessly. Truth didn't matter, the hyped up emotionalism of it all was a windfall for the media.
It's a bit like having a conversation with someone and as soon as they start talking about chemtrails it's an uphill battle to take anything from them seriously after that.
Also, its odd to me that people intentionally try to misrepresent raw intelligence. Raw intelligence is so named because it's an amalgamation of different sources and even possible rumors that were deemed pertinent to include. Intelligence officials regularly deal with these, so there are established procedures to verify its contents independently. So to hear you say that since one thing may be wrong, then everything is wrong, therefore it's fake, seems deceitful.
Lastly, we have the curious fact that most every Russian implicated in cooperating with the Steele dossier had been murdered, found dead, or arrested by the FSB shortly after its existence became known to Russian security services.
Id also suggest it's odd for a sitting president to repeatedly obstruct an investigation that he steadfastly maintains will find nothing.
For me, the moment all my trust in NYT died was the election day. The front page had this interactive realtime story of how Hillary is supposedly winning by overwhelming margin, when it was very apparent that that's opposite of the truth. People kept questioning "where the hell is this data coming from?".
I believe Newspapers should try to play as much neutral role as possible, but throughout the entire election cycle the narrative was NYT vs. Trump. News organizations and journalists should report stories but should not become the story.
As someone who just wanted to learn what REALLY is going on, I had (and still have) hard time believing anything they say anymore. Other conservative publications at least don't claim to be neutral. A publication shouldn't claim to "tell the truth" and do a whole TV ad about it if they are clearly biased and they're also aware of this.
I know they're being provocative because this sells, and they need to make money, and it's getting harder to make money with newspaper. But they've crossed the line.
People keep talking about "fake news", but what's really dangerous is not some viral website that write some funny photoshopped story. What's really dangerous is influential news organizations like NYT doing deceptively objective-sounding pieces with narratives that mislead the public.
By now I think a lot of people know it's very possible to take a same piece of reality and write completely different versions of it, just by framing them differently. Because of that I have hard time believing anything online anymore, especially the influential ones. This is sad because it used to be the job of journalism to fight against injustice, but nowadays it's more about generating more page views and getting more subscribers, which led to people losing faith in journalism.
I remember that interactive story. It was not what you describe. It was showing Hillary's chances of winning throughout the evening - she started at 90% or so, based on the polling averages they'd been running on a regular basis throughout the entire election season. Then, as the evening wore on, and results were not as the polling would indicate, her chances of winning dropped, dropped, and then obviously went to zero.
Now, I won't argue that in hindsight that was a pretty bad feature to run. I think it vastly overestimated reader ability to understand statistical probabilities, as well as the accuracy of polling data (the Brexit vote ought to have been an indicator to be cautious). But it absolutely wasn't showing false data that indicated Hillary was winning when she was not.
Everyone was wondering (both pro-trump and anti-trump) where the "90%" came from. Because it was pretty clear the race was not that obvious. People keep saying nobody saw it coming, but that's their emotion speaking. People just didn't want Donald Trump to win because they thought he's a joke, but objectively speaking people knew clearly that there were tons of his supporters around the U.S., and it was definitely NOT 90% chance that Hillary would win.
To me, THAT's the ultimate "fake news". Slapping a percentage number on it and putting it on the front page is just not right, especially when it's based on very subjective (and eventually false) speculative data.
"The front page had this interactive realtime story of how Hillary is supposedly winning"
I said:
"it absolutely wasn't showing false data that indicated Hillary was winning when she was not"
They're pretty clearly contradictory. That data, at no point, showed Hillary "supposedly" anything. You're making my point about readers not understanding statistical probabilities. 90% doesn't mean she's winning. It means she's got a 90% chance of winning, and there is a 10% chance she will lose. She lost.
> People keep saying nobody saw it coming, but that's their emotion speaking.
Quite the opposite. The data (that same data you're saying came from nowhere) showed that Hillary had a 90% chance of winning. There was variance in the polls, but pretty much all of them showed Hillary with an edge. Yes, there were a great many reports of people saying that there was a lot of Trump support across the country, but those reports are the very opposite of "objective" - they were thinly spread and anecdotal. Pretty much every newspaper ran stories interviewing those Trump supporters, but there was no hard data to quantify it.
Polling data isn't "subjective" and "speculative". There is a clearly defined methodology behind it. That methodology was incorrect in the 2016 election, and didn't accurate gauge support for two unprecedentedly unpopular candidates. That makes it "incorrect news", not "fake news".
You could argue that the news industry has relied too heavily on this sort of statistical prediction stuff, and I'd agree with you. But in 2012 FiveThirtyEight correctly predicted all but one state, and everyone absolutely lauded Nate Silver for it ("Is Nate Silver a witch?"). But really, what that meant is that each of Nate's predictions were the right side of 50%. And in 2016 they most definitely weren't.
Really, I think most of the incorrect predictions came from one error: assuming a higher level of independence between state results than is actually the case. Nate Silver/538 talk about this some, and they gave Trump the highest (~30%) chance of winning on election day.
All of these things could have occurred, but something definitely was wrong with the polling data. Nate Silver just like NYT gave Hillary a 90% chance at the start of the day, and this was all based on using the polling data as inputs to their models.
He didn't though, and that's my point. What you're saying is factually untrue, they haven't updated their prediction since election morning, and it sits at 71% Clinton [0] (Updated Nov. 8, 2016). If you don't believe that, then you can take a look at archive.is, which provides timestampped copies. This [4] is an archived copy from well before polls closed (3:30 PM), there are others from earlier in the day.
I don't know what led you to believe that it was a sure clinton win, but that just wasn't the case.
Clinton won the popular vote by somewhere between 2 and 3%. National polls from just before the election (also per 538, [1]):
+4, +2, +3, +4, +4, +4, +4, +4, +2, +3
An arithmetic average of those gives C + 3.4.Take Florida, a state trump won, here's polls taken in Novemeber [2]:
+1, -3, +0, +2, +1, -4
An arithmetic mean gives -.5, Trump won by about a percent.Take Pennsylvania [3], another close state. November polls again
+1, +2, +4, +6, +3, -2, -2, +0, +0, +2, +2
An arithmetic mean gives Clinton + 1.18, Trump won by about .7, so this was perhaps the greatest polling blunder, and its still a margin of under 2%, which isn't unheard of.[0]: https://projects.fivethirtyeight.com/2016-election-forecast/ [1]: https://projects.fivethirtyeight.com/2016-election-forecast/... [2]: https://projects.fivethirtyeight.com/2016-election-forecast/... [3]: https://www.nytimes.com/elections/results/pennsylvania [4]: https://archive.fo/4EQGB
But I don't think you got my point either. The detail doesn't matter. Whatever that number was about, it was pretty clear that 90% was not the right number, I'm not even pro-trump and I was confused, imagine what others thought.
Also, it is not ok to be irresponsible just because you're using a "scientific method". This is what cigarette companies did to fund research that "prove" that smoking is healthy. And this happens increasingly more, because writing polarizing articles generate more shares and page views and money.
Lastly, I am not trying to talk politics here, and it's not even just about NYT. Nowadays for a lot of writers it's all about generating more page views. Again, I'm fine with it (even the "fake news" viral sites), but I was pointing out that it is hypocritical to claim that you're "the truth", when you do things that are biased.
If I win the lottery, is it misleading for people to state that my odds of winning were one in a million?
It's not misleading to say your odds of winning the lottery is one in a million because it IS one in a million, mathematically. NYT saying Hillary would win by 90% chance is NOT mathematics. Do you really think your analogy was adequate?
My point was that people believe statistics, just like you believe that because NYT did it, it would be scientific and you should believe it. But that's where the danger lies. And an influential publication such as NYT should be ashamed of themselves for misleading people by trivializing things down to just a percentage and feeding it to the world, in realtime.
I'm sure a lot of Trump fans who saw that poll on NYT that morning who didn't care for voting decided to go vote.
Actually yes, that is exactly what I'd like to find out more about. I'm asking why you are so sure that the NYT and other media publication odds were so wrong? Is it just that he won, therefore his odds must have been better than 10%? Most betting markets (which the HN set seems to put a lot of faith in) had Clinton as a 80ish % favorite (http://www.cnbc.com/2016/11/07/betting-sites-see-record-wage...), do you think they were a product of a misled public?
Again, that's how probabilities work. Unless the prediction was 100% Hillary win then a Trump win is possible. This isn't a new concept, it happens in sports all the time. Odds are offered for betting, and every now and then there are upsets. That doesn't mean the odds are nonsense.
What's the alternative? News organisations never even attempt to gauge whose campaign is more popular? I don't think that's realistic.
Was it? Maybe 90% didn't match up with your intuition, but NYT wasn't making that number up out of whole cloth. That's what the polls were saying, as analyzed by the NYT polling staff.
Maybe they were wrong (maybe they weren't-- things that have a 10% chance of happening happen all the time), but you certainly haven't demonstrated, or even really attempted to demonstrate, bias. All you've really said is:
* Trump won
* Your intuition told you he had a greater than 10% chance of winning before election day
> throughout the entire election cycle the narrative was NYT vs. Trump. News organizations and journalists should report stories but should not become the story.
It's important to remember that this narrative largely came (and continues to come) from Trump, and he benefited greatly from it.
No, they weren't, because everyone paying even a little bit of attention to the issues around aggregating polling numbers new that 538 had already dissected the problem with that long before the election—most prediction models were falsely assuming that variations in outcome from.the poll averages between different states were independent events when history shows that such deviations are strongly correlated. Which is why 538, working with essentially the same polling data as everyone else, had Clinton's chance of losing much higher than NYT and some other predictors.
> To me, THAT's the ultimate "fake news".
Predictions of the future are (and were presented as) analysis, not news. To be "fake news", it has to firsr pretend to be news, that is, reports of things that have occurred.
I think that's where the confusion lies. The majority of published polls and pundit calculations pointed that way, and it was earnestly interpreted by well-intentioned journalists that 90% of polls meant 90% probability. Perhaps I'm cutting a little too deep with Hanlon's razor here, but I think systemic biases are a more likely culprit than some kind of media conspiracy.
My own observation during the days leading up to the election was that her chances of winning were decreasing at a faster rate than could be reported with reliable polling data, though I still believed that she'd eke out a win.
I don't remember that at all. I remember the chances of winning, but that is not in any way a claim that she is winning by a large margin. In fact, reading the articles during the campaign and during election day, there was a lot of talk about even though polling data read one way, Trump wasn't out of it.
But yes, if you just read the headlines and didn't actually read the content, I could see why you'd say this.
And here's the page I was talking about: https://www.nytimes.com/elections/forecast/president
Now it says >95% Trump, but on that day it was the other way around--something like >95% Hillary.
That being said, predicting the outcome of an election with some 250 million potential voters based on a few hundred thousand polled individuals is a tricky game to play.
And, fwiw, your sort of political "objectivity" just doesn't exist. What you want is the sort of fake equivalence as in "Yesterday, 10 people died in an earthquake in Northern Italy, according to local accounts. But Jeff from Kansas writes on Twitter that there was no earthquake and the cause of death was the LHC's creation of a black hole. What's the truth? You decide! Back after this...".
It's like saying "Nobody is perfectly ethical. So trying to be ethical is just being fake."
Also you are using a funny example to make a point that's not relevant to this instance. That has nothing to do with news organizations siding with certain political party and pretending to be unbiased.
It wasn't just the New York Times, it was every single news outlet and every single poll. We have been running and studying elections for over 100 years, you would think, by now, that if we had any idea what we were doing, we would have long ago learned how to perform actual predictions using the data available to us.
When people break their legs, we can cure them 100% of the time because medicine has a strong answer for this problem based in thousands of years of medical science. Election polling and prediction is simply not in the category of "solved" problems.
If the statistics were really well understood...as some of the people arguing with you are claiming...WOULDN'T WE HAVE FIGURED THIS OUT BY NOW?
I have had these discussions about polls and statistics with my Liberal friends. Many of them are software engineers. Some of them even work in ML at large scale. They are utterly convinced that the data and statistics just need to be tweaked a little bit more and THEN they will be correct. To quote Donald Trump: WRONG!
There is a simple explanation for what happened that does not get into nit-picking statistical nuances. There is a simple explanation that does not allow people on the other side of the argument to bludgeon less educated opponents into silence by spewing technical jargon about polling data (which is really just a manipulation technique used to silence people by berating their intelligence).
The explanation is that the polling data was simply made up.
Or that many prediction models were created and only the ones favorable to the desired narrative were selected as being "Accurate" by people who are blinded by deep personal political bias.
This outcome scares people who prefer to see the world in a particular way.
People want to believe they aren't biased or that everything they read and see everyday is somehow "clean" or being presented by rational experts. That is a scary thought process...software engineers, in particular, cannot bear to believe that because it violates their underlying belief that the world operates in a logical way.
So instead of thinking like this, they crack open statistics textbooks and start reading chapter 4 at you. Its a defense mechanism to avoid reality.
There are direct financial rewards for telling people exactly what they want to hear. If Nate Silver and 538 consistently told people that Donald Trump would win, it is likely that their page-views would plummet into oblivion. Instead, the vast online hoards who like to be told whatever they want to hear and read news only to have their existing beliefs confirmed swarmed over Nate's websites, clicking on articles and gleefully watching the ads.
What is Nate Silver's punishment for being wrong over and over again? Nothing! There is no identifiable drop-off in his web traffic despite him and his team being wrong about everything this last election.
If what Nate Silver was doing was really "data journalism," shouldn't his following online have dropped off a cliff? It hasn't and it won't because what 538 is doing is not really backed by data and his readers and viewers are not discerning enough to care or believe that what they are reading is just opinion.
I am fairly disgusted by humanity at this point as a result.
Keep strong my brother, you are right. The people quibbling with you are living in an alternate reality where the media isn't incentivized by page views to gravitate towards narratives that result in more clicks. The media is dead.
You don't feel like you are oversimplifying a bit, and applying your own bias? Any pollster knows (and I realize you may ignore this point due to that opening bit) that there are margins for error as long as your sample size is any smaller than 100% of the population. Further, any pollster knows that your data will be skewed by how a question is worded.
The data wasn't made up, and each outcome was within the predicted margin for error. Many people will accuse the statistician of using large margins for error to cover any issues in the data, but that is straight from the opposite end of the spectrum of error.
> People want to believe they aren't biased or that everything they read and see everyday is somehow "clean" or being presented by rational experts. That is a scary thought process...
No one believes that everything they read is clean; anyone who does has (again) oversimplified the world. It isn't black and white. Every day, the margin for error is being examined, polls are being refined, questions are being tweaked. If the pollsters thought they had it all nailed down, why would they even be re-evaluating the method?
The only way to get 100% accurate data would be to poll 100% of the people who are going to vote -- and 0% of the people who aren't. Oddly, that is what happens on voting day -- at great expense, through great manpower, and with great effort. Pollsters simply don't have those kinds of resources.
> There are direct financial rewards for telling people exactly what they want to hear.
People do love to be reinforced, but again you are drastically oversimplifying a more complex issue. No matter what happens, no matter the outcome, people want to read the polls.
I mean, why do we even have them otherwise? So regardless of the error bars or margins, polls are going to keep happening; some will be correct, some won't. Most will fall within fairly narrow margins for error, but often the <50%> marker is in that margin -- so the opposite outcome could happen, even within the poll's own admitted rules.
> So instead of thinking like this, they crack open statistics textbooks and start reading chapter 4 at you. Its a defense mechanism to avoid reality.
Unnecessarily inflammatory, I think. The worst part about this rant is that the polls were so close to accurate -- especially if you count the popular vote, instead of the electoral college outcome. It all seems to be a symptom of a country that is, perhaps, too large and diverse for a federal government. I would argue for States' rights here, or say States should be more largely self governing -- but you do need a mechanism to get money from California (taxed $405B, received $343B in federal expenditures) to Kansas (taxed $9.9B, received $24.2B).
That was a bit of a tangent; the point is that the setup of the United States government, both from the State side and Federal side could use some work.
> What is Nate Silver's punishment for being wrong over and over again?
And what is his reward for how often he is right? He works in an industry with a large margin for error. Are you arguing that statistics should basically be abolished? Fivethirtyeight does far more than political polling, mind.
The other thing is relative; Nate Silver was far closer to the mark than any other publication, and his data were more robust. If you are arguing that Nate should lose traffic, every other organization (including those that argued for a Trump win based on similarly faulty statistics) should receive even more loss?
> If what Nate Silver was doing was really "data journalism," shouldn't his following online have dropped off a cliff?
But he was working with the data he had. Fivethirtyeight doesn't even do its own polls; it aggregates data from other polling organizations. Should Nate have made up the data? That is the exact opposite of what you are arguing, and I think your anger is misplaced.
> I am fairly disgusted by humanity at this point as a result.
If a set of polls being off by less than 3% is your threshold for a disgust in humanity, I am afraid your view is narrowed to the point of being useless. There are bigger things to worry about, at least as far as I am concerned.
I just wanted to point that out, in the end.
https://web.archive.org/web/20161101110545/http://www.nytime...
In this time of political discord and journalistic polarization, I am surprised and disappointed that such an esteemed paper would decide this position is no longer necessary.
I hope the NYT keeps the existing archive online, and frankly I may still add this archive to my media literacy app — even though the underlying stories would become increasingly stale over time. IMO, it is that good!
Here's her 'back catalog' of stories from the NYT: https://www.nytimes.com/by/margaret-sullivan
I don't see anything in the article that makes me feel like they are interested in fixing that problem.
- (some) polls were systematically off, mostly because they underestimated white non-college turnout and overestimated black turnout. Note that poll errors were actually lower than for any other election–only this time they actually got the winner wrong.
- Most of the poll aggregators operated under the assumption of statistical independence of state-level results. This was a serious mistake, and both Huffpost as well as The Upshot (to a lesser extend) should be somewhat ashamed. 538, by the way, did this right and had Trump at 3X% on election day.
- There actually was some significant change in voters' intent in the last days, possibly fuelled by all the news stories the FBI directors was generating. It's highly likely that an election two weeks earlier or two weeks later would have ended differently.
It's also important to note that newspapers aren't really in the business of predicting the future. If they "relied too much on social media" for any facts they reported, I'd love to see some examples.
That is, we're not just talking about getting the numbers wrong. The "narrative" itself is way out of whack as well.
> it’s now clear that Mrs. Clinton was weaker heading into Oct. 28 than was understood at the time. Several other polls were conducted over the same period that showed Mr. Trump gaining quickly on Mrs. Clinton in the days ahead of the Comey letter. And the timing of these polls — particularly the gap between when they were taken and when they were released — has probably helped to exaggerate the effect of Mr. Comey’s letter on the presidential race
https://www.nytimes.com/2017/05/08/upshot/a-2016-review-ther...
The problem was so many people just hated Clinton, and at the time, Trump had more people positive about him.
I look at net Promotor Score on any type of entity. It's predicted the rise of Bicoin, and various other currencies, but it's not always perfect. For example, it didn't predict a brexit.
It could just be I don't have enough data. It's a work in progress.
I will say that when I eventually sent an email to the NYT's corrections email address, they immediately fixed the errors in the articles. This won't help with close judgment calls or understanding how the newsroom works, but at least it can be used to address blatant errors.
Yes they did. They know it. And they don't really give a fuck.
After the election they did some public navel gazing about what went wrong. To prove they were serious, there was even an editorial about The Future of the Times.
So I wrote to Ms Spayd. I challenged her, at the next meeting of journalists and editors, to say something like: "show of hands, who voted for Donald Trump for president".
My contention is that the result would be zero. Nada. Zilch. Even if they did vote for Trump, they wouldn't be dumb enough to admit it publicly to a room full of their colleagues.
So how can the Times ever begin to understand the 46% of the country who are the deplorables who voted for Trump?
They can't, and they don't want to.
Or, maybe, Ms. Spayd actually did what I suggested. And the powers that be decided that she just wasn't a good fit for them anymore. And that's why she was shown the door. :)
You don't need to be a member of a certain group to be able to report on them. E.g. you don't need to be terminally ill to report on people that are terminally ill, or member of the KKK to report on them.
If there are ZERO Trump voters among staff at the Times, that is a strong indicator that the Times reporters are spending a lot of time in a bubble, and could benefit by hiring a conservative just to function as devil's advocate (like Fox News did with Alan Colmes).
They do hire conservatives (Brooks, Douthat, Kristol, etc) and they just hired Bret Stephens.
> (like Fox News did with Alan Colmes)
You make it sound as if Alan Colmes, during his time at Fox, was there to give an equal voice to the liberal side of an issue, but in reality he was just marginalized to be the token "lefty" punching bag for Hannity.
But even putting someone like Douthat on the editorial side doesn't impact the news side of the Times.
I think the NYTimes does a pretty decent job, but there is no question they missed the story of 2016 because their news reporters are all inside the bubble.
Agree that Colmes was an unglorified punching bag. Fox is the wrong entity to imitate.
From where I sit, the Republican party (often called "conservative") is divided into several factions right now. The think-tank side traditionally caters to three of them: neo-conservative / "law and order" type causes, libertarian causes, or business interests. The Republican party also is the home of both a religious / fundamentalist wing, and a cultural-identity / white nationalist wing; these sides are generally not well represented in the think tanks.
Maybe the later two are what you consider "mainstream"? The issue with the later two camps is that the representative media can be very populist in nature. And populism can be very us-vs-them / emotion driven, sometimes with disregard for facts. This probably would not fit well at all with the current editorial stance of the Times, even if the populism comes from the left.
But even Brooks knew enough to publicly declare that he wouldn't vote for Trump, even though Trump's political views probably aligned more closely to Brooks than Hillary's views did.
Then I'm not sure why you have such a strong opinion of the NY Times? Also, no one at the paper is using Brooks as a token conservative in the same manner as what Colmes was for Hannity. Brooks even appears weekly on PBS.
> But even Brooks knew enough to publicly declare that he wouldn't vote for Trump, even though Trump's political views probably aligned more closely to Brooks than Hillary's views did.
Political views aren't binary. Brooks can have differing views from Trump and Clinton. I don't understand the underlying need to declare blind allegiance to Trump just because one is a conservative.
Not that Trump is a true conservative, but ...
Our current political system more or less forces binary choices.
E.g. take the case of the Supreme Court. Unequivocally Gorsuch is a much more conservative appointee than Garland would have been.
Were Trump's negatives so high (in Brooks' eyes) that Brooks was willing to accept perhaps two or three liberal court appointees from Hillary rather than live with Trump's baggage? Apparently so!
(And let's not even get into how loaded of a comparison you just made...)
That's because reporters don't generally despise the terminally ill.
But if you want to honestly report about politics, then you can't think of people as deplorables. You can't automatically ascribe all sorts of negatives to 46% of the country because they didn't vote for "your" candidate.
If you despise what you're reporting on you will never, can never, report honestly. Your biases will overwhelm your coverage. You will not be able to understand what you're writing about.
And in the case of the Times, they don't even make an attempt at impartiality. They don't need to. Their target audience exists in the same bubble.
- Departing NYT Public Editor Clark Hoyt
SOURCE: https://mobile.nytimes.com/2010/06/13/opinion/13pubed.html?r...
https://www.washingtonpost.com/blogs/erik-wemple/wp/2017/05/...
https://theoutline.com/post/1372/the-new-york-times-public-e...
This is a disturbing statement. Shouldn't a serious newspaper's mission be to investigate and report facts without regard to the "connection" it creates or dissolves with the reader? I'm sure Infowars has a deep connection with its readers.
This is a profoundly ridiculous statement but I think it represents what the NYT has always been quite accurately.