OPEN UNIVERSITY JANUARY 10, 2008
-
Read Later
READ LATERAvailable only to subscribers. SUBSCRIBE TODAY
-
Listen
ARTICLE AUDIO
- Font Size
All of the experts thought that Obama would win the New Hampshire primary. Perhaps more significantly, the prices at Intrade, the political prediction market, suggested that Obama was overwhelmingly likely to win. Many of us have been quite excited about the potential of prediction markets, in which people "bet" on political (and many other) outcomes. Such markets have a terrific track record. And yet Clinton was a huge underdog in New Hampshire. Should we conclude that the prediction markets are unreliable after all? That nobody knows anything? That polls themselves mean nothing?
The answers are no, no, no. The problem is that as in so many domains, a single, unlikely event (here, the stunning surprise in NH) is leading to a ridiculous generalization about the world.
More particularly: Intrade had Clinton at about 8% likely to win, and 8% of the time, 8% chances should come through. (As in horse races, so on Intrade.) It would be a great surprise if 8% chances come though 0% or even 2% of the time. But on prediction markets, prices have been close to probabilities. Events that are priced to be 90% likely to happen occur about 90% of the time, events that are priced to be 70% likely to happen occur about 70% of the time, and so on.
The current skepticism about prediction markets is being driven by the well-known availability heuristic, in accordance with which people assess probability by asking whether events come easily to mind, or are cognitively "available." The success of the long-shot in New Hampshire is now very available indeed. In fact we are witnessing an availability cascade, in which the single incident spreads rapidly from one person to another, leading to the (false) belief that the prediction markets are quite unreliable.
There is a more general point. Some people are now doubting not only the prediction markets but also the polls, saying that no one knows anything, and that anything is as likely as anything else. Don't believe it. Of course no one has a crystal ball, but the polls are generally pretty good -- and if you want to have a sense of the probabilities, you'd probably do best to consult Intrade.
--Cass Sunstein
4 comments
At one point, Intrade had Obama up at 98% in NH.
That rattled my faith in Intrade a bit. Was Hillary's win really that much of a fluke? Given the poll numbers, and the election-eve movement of voter affections, maybe it was. In the days between the poll sampling (Sunday) and the voting (Tuesday), it seems like a perfect storm of variables combined in the right way to give her an unlikely win (e.g. maybe the tears gave her a 1% bonus... Obama supporters staying home because of his overwhelming support gave another 1%...the Bradley effect another 1%....the independents breaking for McCain instead another 1%, etc.)?
But all of this makes it sound as if Intrade traders are just garden-variety poll watchers.
- huntlib
January 11, 2008 at 4:28pm
University of Chicago law prof Cass Sunstein has a useful post defending prediction markets like Intrade against critics who bashed them for failing to foresee Hillary's win in New Hampshire. As he correctly notes, long shots sometimes do win: Intrade
- Anonymous
January 12, 2008 at 2:25pm
I love reading Sunstein. It's like breathing pure rationality. As for 98% huntlib, yep, this was a major, major, major fluke -- highly unlikely given the polls. Very hard to come up with other examples of polls being this wrong so close to the event. But 2% is still 2%, and will happen once in a while (2 out of a hundred, to be exact).
- jhildner
January 15, 2008 at 6:13pm
"The Diebold Effect": Hillary's Votes Higher From Diebold Machines Even Controlling for Demographics (education, income, population, etc)
scienceblogs.com/.../the_diebold_effect_hillarys_vo.php
[In contrast to exit pre-election polls, the final vote tally from the NH democratic primary shows a surprise victory for Hillary Clinton. People quickly noticed an anomaly in the voting tallies which seemed to show an advantage to Hillary conferred by the use of Diebold machines.]
- AaronBBrown
January 16, 2008 at 10:17pm