Foxy Nate Silver and why old-media hedgehogs could soon be old news
pandodaily.com
pandodaily.com
"In 2008, the RealClearPolitics polling average was incorrect in two states — Indiana and North Carolina. Silver botched Indiana but correctly called North Carolina. In 2010, it was much worse. State polling averages were wrong in Alaska (they said Joe Miller would be elected), wrong in Colorado (they said Ken Buck would be elected), and embarrassingly wrong in Nevada (they said Harry Reid would be involuntarily retired). FiveThirtyEight incorrectly forecast the winner in each of those states, perfectly reflecting the inaccurate information contained in the state polls. Thus, of the five major state races in which polls were wrong over the last four years, Silver only got one right."
Why don't people wait and see what happens?
But I don't follow your evidence at all. The primary data output from 538 is a single number -- a chance of winning the election. How is that refuted by the inability to call every single state race? No one, certainly not Silver, claims to be able to do that. But numerate folks still understand that those probabilities can be combined to give a meaningful answer.
So let's flip it around: why don't you believe the (currently) 83% figure? If your answer is because some of those states will come out differently than their median expectation, you're completely missing the point.
However the question is this. Do you have anything more accurate? I've had the experience on NPR of hearing pundits going on at length about what states matter. And it was less informative than a glance at http://www.electoral-vote.com/ is.
So no, it is not perfect. Nobody, particularly Nate, says that it is. But we don't have anything better.
It is based on the polling data, so if the data is off the snapshot will be off, but otherwise it seems to provide a great snapshot of the Election.
edit: I just looked at your comment history. Repeating the same comment over and over is going to cause problems.
It take's a poll's historical accuracy into account when weighing its impact on the model. This is where he gets an additional degree of accuracy as opposed to straight poll aggregation. So it actually does "choose" which polls to believe...
Unbiased != more accurate. If, for example, there is a poll you KNOW is doing something wrong, you should down-weight it. A pure polling average there would be wrong. However, once you start weighting polls, people start criticizing the way you do it.
This isn't much different.
For both the games and the election, we will wait and see what actually happens. In the mean time, we enjoy discussing and forecasting.
> Hedgehogs are “type A personalities who believe in Big Ideas – in governing principles about the world ... Hedgehogs are more easily seduced by clear narratives. Foxes are more data-driven, less willing to stake out strong positions.
Wouldn't you say this article is definitely a "clear narrative" and a "strong position" that is not backed up by data, nor does this categorization of people seem to show "nuance, uncertainty, complexity, and dissenting opinion"?
It's an article for hedgehogs.
Wouldn't a better bet be something like $800 to Scarborough's charity if Romney wins or $200 to Silver's charity if Obama wins given that Silver has Obama at 80%? That makes Silver's confidence more visible than by using an even bet.
See the Kelly criterion if you don't know what I am talking about.
http://www.intrade.com/v4/markets/contract/?contractId=74535...
the idea that bookies and betting sites have something to teach us about real outcomes is a little rich. the optimal outcome for a sports book is to have heavy betting in the wrong direction.
Yes, I'm aware that this way of thinking is odd to people who do not understand markets, gambling, and so on. But it is still true. Bookies try really, really hard to give correct odds. And if you look at 20 bets which had 80% odds, you would expect to find several examples where the expected winner lost. That's why the odds were set at 80% and not 99%.
https://twitter.com/fivethirtyeight/status/26394803410527846...
i'm mixing examples here. intrade is a betting market, no line is set by a bookie - it measures public opinion. one way to look at it is that intrade is efficient and there was truly a "20% chance it will occur." the other way to look at it is "the odds were never 80/20" because most people betting on it were uninformed or misinformed (clearly watching WAY too much Fox news). this is unknowable, because it's not a repeatable event. prediction markets were originally based on the idea that folks with inside information would bet heavily and clearly justice roberts had other stuff to do.
understanding how sports books work is not the same as saying "i know enough about sports to bet profitably." that said, bets set by a casino or sports book are different than intrade. a bookie is trying to maximize house profit, whereas intrade is pure sentiment. a sports spread can be -2 with 80% of people betting one side. the house might think the real spread is -4, and they expect the line to pay off. here's an example of how lopsided bets can be:
http://www.thespread.com/ncaa-college-football-public-bettin...
I'm reading "sharp sports betting" by sanford wong right now. good quote:
"I had the opportunity to ask Robert Walker, race and sportsbook director at MGM mirage, whether his company's action is balanced on football games...it appeared to me that sportsbooks might be taking lopsided action on about half of all NFL games. Mr Walker answered that what I hypothesized was indeed the case....then i asked him why he did not make more line moves to try and balance the action. his answer was that to move the line to try to balance the action would result in less profit for the sportsbook."
Seriously, if someone is offering wrong odds and you're sure of it, you can consistently make money. Go for it!
Technically, the individual mandate was illegal under the commerce clause according to the ruling. This was the main area of debate and clause that people assumed it would fall under.
The surprise was the expansion of the taxing power given in the ruling allowing the individual mandate to be considered a tax. It also was small enough not to be considered punitive, thus still legal under the "expanded" taxing power.
If there's 80% chance of something happening, it doesn't mean that the 20% alternative won't happen or that you was wrong if it happened.
I really am not sure what the point of predicting is unless you're betting, or unless you're a high-level campaign manager who needs to allocate resources in various districts/states.
One purpose of predicting the outcome is to take the narrative back from the pundits whose obvious motives are to maintain the perception of a close race. That's media bias. The FivetThirtyEight is a response to that.
You have a candidate you are backing, with your time and/or money. But you are not made of time and money. What are you doing this weekend, working in the yard, or at the phone-bank? Signing checks to your candidate, or putting that money back into your business? Predictions help a lot here - they're useful for time and money allocations other than just at the "high-level campaign manager" level.
I agree that disinterested parties have a lot to gain from a probabilistic analysis, but someone who's working at the phone bank likely cares deeply about the cause and is convinced that their efforts can make a difference. At a macro scale, they do make a difference.
It's precisely those kinds of actions which shift the overall probabilities regarding the outcome.