SUBSCRIBE NOW WELCOME BACK. Do you want to continue reading where you left off? New Republic subscribers can pick up where they left off no matter which device they were previously using. SUBSCRIBE NOW

Go Home Nate Silver Is Not The Only Solution

PLANK DECEMBER 3, 2012

Nate Silver Is Not The Only Solution

Nate Silver sat with ESPN sportswriter Bill Simmons for an hourlong podcast, published Friday, during which they compared Silver’s role in politics to statheads’ role in sports around a decade ago—both being disruptive forces that introduced numbers-driven objectivity to an insular, clubby, subjectivity-dominated universe. This led to some juicy Politico-bashing: “They’re trying to cover it like it’s sports, but not in an intelligent way at all,” Silver said of the site. At another point, he quipped, “The pundits who come on TV and pontificate are not analogous to the scouts—they’re totally useless” (the pundits, that is).

In Michael Lewis’ Moneyball, general manager Billy Beane and his number-crunchers are juxtaposed with the scouts: grizzled ex-ballplayers who watch prospects and write reports based on their own observations and experiences rather than any sort of externally consistent metric. Silver’s distinction is important: the neat stats/scouts dichotomy pushed by some writers overlooks that Beane himself was an ex-ballplayer and that the scouts have much to offer (as Silver noted in the podcast, Beane’s Oakland Athletics have actually increased their scouting budget over the past decade).

But Silver is wrong about the supposed worthlessness of TV pundits and horse-race reporters. Some of the more vapid cable commentators and some of the less-schooled reporters are indeed “totally useless,” and it is therefore inaccurate to say they are the scouts of politics. But many political journalists, even those concerned primarily with winners and losers, are, like the scouts—and unlike the statheads, whether they work in the Toronto Blue Jays’ front office or for the New York Times’ FiveThirtyEight blog—deeply informed observers concerned with truths that the numbers cannot provide: how candidates handle pressure and manage staffs; how ideology intersects with rhetoric, policy with politics; and other information of value to voters. There's more to covering politics than what's dreamt of in FiveThirtyEight’s philosophy.

In fact, so much of the (necessary) defenses of Silver, after the attacks against him before Election Day, obscured just how purely he is a horse-race journalist, concerned to an almost unique degree on outcome to the exclusion of everything else. It was completely wrong to say—as many said, in so many words—that he was “trying to cover [politics] like it’s sports, but not in an intelligent way at all.” But it is undeniable that he does cover politics like it’s sports.

Meanwhile, Simmons, whose entire career is built on the premise that he is the ultimate sports fan—he goes by “The Sports Guy,” after all—is proof himself of the limits of statistics as a prism for understanding sports. From his early write-up of the annual MIT Sloan Sports Analytics Conference up through Grantland, the ESPN-backed magazine he edits, which employs several such analysts, few have done more to patronize and popularize the statistically informed study of sports than he has. Last week's podcast was further proof that Simmons considers himself of the camp that not only understands the basic philistinism of many of the traditionalist critics, but actively embraces a data-driven approach to sports.

And yet, Simmons is not a numbers guy; he’s a fan. “I remember the days when maybe I was a little intimidated by the numbers,” he told Silver. They are not that long ago. He remains a complete Boston homer, in ways that can skew his analysis, as happened (he admitted on the podcast) during the New England Patriots’ 18-1 season in 2007. Discussing basketball strategy, he is likely to use numbers and even obscure stats; but discussing it viscerally, the day after, he can be as purple and heuristic as any local columnist.

Support thought-provoking, quality journalism. Join The New Republic for $3.99/month.

One salient example is Simmons’ oft-repeated “gambling rules,” which include never betting on a playoff football team that’s playing on the road with a rookie quarterback. The last written, coherent articulation and application of the rules I could find is a column from early 2010—nearly three years ago, but well after Simmons had, say, attended a Sloan conference. Justifying a few of his new rules, he even resorted to some numbers—“QBs with a 95-plus passer rating: 1999 (two); 2009 (nine). Seven of the top 53 QB ratings all-time were posted this season”—in insisting that you had to be able to throw the ball exceptionally in order to win in the playoffs. 

Having established his rules, he applied them to that year’s playoffs. He mocked New York Jets coach Rex Ryan’s confidence in his run-first offense, and added, throwing Ryan’s words back at him, “The Jets don’t have a chance in every game ‘this time of year.’” In fact, the Jets won two straight upsets. “The most potent force in January and February is the ‘Nobody Believes in Us Theory,’” he stipulated. In fact, the two teams with the best records entering the playoffs faced each other in the Super Bowl. He picked against the spread for the playoffs’ first four games, and he got all four wrong (and all four wrong outright).

The lesson isn’t that numbers lie except when they don’t, or are best handled by experts, or are inapplicable to the single-elimination NFL playoffs (although there is probably truth to all of those theories). It’s that even hyper-educated sports fans—professional sports fans, like Simmons—will continue to apply goofy, superstitious theories right alongside the numbers. And lest you think sports’ lower stakes means this won’t also be true of politics, recall that Simmons, who frequently jokes about placing wagers “if gambling were legal,” likely had money riding on those picks. People, as emotional beings, are not always going to listen to what the experts tell them, whether the subject is the horse race of politics or an actual horse race.

Nate Silver, too, is human. Discussing baseball’s two most cursed franchises, he told Simmons, in jest but not really, “I’m not sure if for the Cubs or the Red Sox, the normal numbers apply.”

SHARE YOUR THOUGHTS

Show all 10 comments

You must be a subscriber to post comments. Subscribe today.

10 comments

Well he is right about da Cubs. Physicists should study them. Perhaps they will find a clue to a parallel universe, an "alternate reality," in Airbus-speak, or even a worm hole?

- Sophia

December 3, 2012 at 1:30pm

You must be a subscriber to post comments. Subscribe today.

Predictions supported by statistics are undeniably valuable to folks who want to imagine future outcomes. The data and the conclusion often seem reliable in the absence of any inconsistencies. However, campaigns and sports contests produce human interest stories that statistics can not foresee.

- Doug12

December 3, 2012 at 1:44pm

You must be a subscriber to post comments. Subscribe today.

If there were any political journalists who, in a non-statistical approach to the election, revealed themselves to be "deeply informed observers concerned with truths that the numbers cannot provide," I missed them. Everyone deeply informed seems to have been working inside the Obama campaign. Mr. Tracy elides a very important distinction between the polls that Silver analyzes and sports statistics: the number of data points in polls dwarfs the number of data points in sports by factors on the order of 100 million. That means that there is a much greater variance in predicting sports outcomes from statistics than in predicting election outcomes.

- roidubouloi

December 3, 2012 at 5:50pm

You must be a subscriber to post comments. Subscribe today.

I didn't watch the Simmons/Silver interview, and I don't plan to, but I do wonder whether the "totally worthless" pontificating tv pundits Silver meant to refer to were those specifically who predict election outcomes on the basis of nada bar their lower gastrointestinal tracts. Of course political journalists who sometimes make softish predictions about how particular negotiations, etc. might play out given the interests and personalities involved have something of value to offer us; it's just that prediction of election outcomes ain't it. And I rather suspect that Silver would agree wholeheartedly with such a proposition. For example, I doubt that Silver would assert that his statistical approach can shed much light on the likely outcome of the fiscal cliff negotiations. A savvy journalist who knows the key players personally and who understands both the economics and politics surrounding the debate can provide the public with much more useful info on this whole conflict than can a stats geek. The stats geek however will tend to provide a better read on the likely make-up of the House of Representatives after November 2014. Really, it's all a question of numbers, as roi sort of suggests. In cases where the relevant decision-makers number in the hundreds, the old-school, in-the-trenches insider will give the best read on the state of play, but in cases where the relevent decision-makers number in the millions--i.e. in elections--statistics trumps insider savvy.

- AaronW

December 3, 2012 at 8:51pm

You must be a subscriber to post comments. Subscribe today.

What I merely adverted to, AaronW very capably explained. I wish I'd said that.

- roidubouloi

December 3, 2012 at 10:32pm

You must be a subscriber to post comments. Subscribe today.

Roid, you meant that factors in sports dwarf factors in polls, right?

- JakeH

December 3, 2012 at 11:16pm

You must be a subscriber to post comments. Subscribe today.

No, I meant that the number of realizations -- events subject to a probabilistic outcome -- is small in sports compared to elections. There are millions upon millions of votes cast in elections and a much smaller number of events in sports -- even when you get down to individual plays -- that can be characterized statistically. The law of very large numbers applies with respect to elections in a way that it does not with respect to sports. Thus, you are going to get many more surprises in sports, even with statistical analysis, than in election outcomes. As well, polls actually ask people how they intend to vote. You can ask an athlete how he intends to play, but even with the best of intentions he or she may not be able to play to that standard. Hence, you have an additional source of variability in sports.

- roidubouloi

December 3, 2012 at 11:30pm

You must be a subscriber to post comments. Subscribe today.

Aaron is right on. Nate Silver doesn't purport to "cover politics." He purports to report accurately on the state of the horse race in electoral contests. Many others, like Politico, purport to do the same, but, because their coverage is based on gut, selective use of data, and fuzzy impressions, it generally sucks at what it's trying to do. This is especially the case where such reports *ignore* the numbers. There is arguably a space for gut-level prognostication and assessment into the state of the horse-race -- that is, before the numbers are in. One might "usefully," or, at least, plausibly have argued right after the first debate that it was likely to be a big turning point in Romney's favor, before knowing for sure. But it was worse than "useless" to characterize Romney as having "momentum" when the numbers showed that his momentum had long since stopped. The debate reminds me of debates of science and religion, where the two sides talk past each other. The religion types feel threatened and accuse the science types of scientism, when, in fact, the scientists are only purporting to say what they know. *They're* not the ones expanding their scope or seizing ground that isn't theirs. Rather, it's the religion types -- in sports, politics, physics, biology, what have you -- who tend to do that.

- JakeH

December 3, 2012 at 11:31pm

You must be a subscriber to post comments. Subscribe today.

Oh, I see. Thanks. I'm an idiot.

- JakeH

December 3, 2012 at 11:32pm

You must be a subscriber to post comments. Subscribe today.

Not at all, Jake, not at all.

- roidubouloi

December 4, 2012 at 12:05am

You must be a subscriber to post comments. Subscribe today.

SHARE HIGHLIGHT

0 CHARACTERS SELECTED

TWEET THIS

POST TO TUMBLR

SHARE ON FACEBOOK

Close