SUBSCRIBE NOW WELCOME BACK. Do you want to continue reading where you left off? New Republic subscribers can pick up where they left off no matter which device they were previously using. SUBSCRIBE NOW

Go Home The Internal Polls That Made Mitt Romney Think He'd Win

EXCLUSIVE NOVEMBER 30, 2012

The Internal Polls That Made Mitt Romney Think He'd Win

 

It’s no secret that the Romney campaign believed it was headed for victory on Election Day. A handful of outlets have reported that Team Romney’s internal polling showed North Carolina, Florida, and Virginia moving safely into his column and that it put him ahead in a few other swing states. When combined with Ohio, where the internal polling had him close, Romney was on track to secure all the electoral votes he needed to win the White House. The confidence in these numbers was such that Romney even passed on writing a concession speech, at least before the crotchety assignment-desk known as “reality” finally weighed in.

Less well-known, however, are the details of the polls that led Romney to believe he was so close to the presidency. Which other swing states did Romney believe he was leading in, and by how much? What did they tell him about where to spend his final hours of campaigning? Why was his team so sanguine about its own polling, even though it often parted company with the publicly available data? In an exclusive to The New Republic, a Romney aide has provided the campaign’s final internal polling numbers for six key states, along with additional breakdowns of the data, which the aide obtained from the campaign’s chief pollster, Neil Newhouse. Newhouse himself then discussed the numbers with TNR.

The numbers include internal polls conducted on Saturday, November 3, and Sunday, November 4, for Wisconsin, Pennsylvania, Minnesota, Iowa, Colorado, and New Hampshire. According to Newhouse, the campaign polled daily, then combined the results into two-day averages. The numbers for each day along with the averages are displayed in the chart below, followed by the actual result in each state:

The first thing you notice is that New Hampshire and Colorado are pretty far off the mark. In New Hampshire, the final internal polling average has Romney up 3.5 points, whereas he lost by 5.6. In Colorado, the final internal polling average has Romney up 2.5 points; he lost by 5.4. “I’m not sure what the answer is,” Newhouse told me, explaining that his polls were a lot more accurate in most of the other swing states. “The only ones we had that really seemed to be off were Colorado—a state that even Obama’s people tweeted they thought it was going to be one of their closest states—and the New Hampshire numbers, which seemed to bounce a lot during the campaign.”

This is mostly true, but not entirely. Set aside Florida and Virginia, for which I don’t have internal poll numbers, but which the campaign apparently believed it was poised to win. Among those I do have, the Iowa number is also questionable, showing the race tied even though Romney ended up losing by almost 6 points. If Romney’s internal polling number in Iowa was roughly accurate, it would imply that Obama won every single undecided voter in the state, something that’s highly unlikely. (Newhouse didn't respond when I emailed him a follow-up question about Iowa.)

Together, New Hampshire, Colorado, and Iowa go most of the way toward explaining why the Romney campaign believed it was so well-positioned. When combined with North Carolina, Florida, and Virginia—the trio of states the Romney campaign assumed were largely in the bag—Romney would bank 267 electoral votes, only three shy of the magic number. Furthermore, according to Newhouse, the campaign’s final internal polls had Romney down a mere two points in Ohio—a state that would have put him comfortably over the top—and Team Romney generally believed it had momentum in the final few days of the race. (You see hints of this momentum when you compare the Saturday numbers in each state with the Sunday numbers. Romney gains in five out of the six states, though Newhouse cautions not to make too much of this since the numbers can bounce around wildly on any given day.) While none of this should have been grounds for the sublime optimism that leads you to eschew a concession speech—two points is still a ton to make up in a state like Ohio in 48 hours—you see how the campaign might conclude that the pieces were falling into place.

Wisconsin, Pennsylvania, and Minnesota are also of interest. Although internal campaign numbers for these states are much closer to the actual results than they are in the other three states (and very close to the final public polls), they at the very least reflect a flaw in the campaign’s assumption that undecided voters would break Romney’s way. If the internal polls are correct, roughly 80 percent of undecided voters actually broke toward Obama.

That aside, the numbers also explain why Romney decided to visit Pennsylvania on Election Day rather than, say, Wisconsin (both states that could have put him over 270 electoral votes had he failed to win Ohio). Pennsylvania, in addition to being a state that neither candidate had spent much time or money in (meaning there would presumably be a higher return on a candidate visit there), actually looked more winnable for Romney than Wisconsin in the final hours of the race.

Newhouse and some of his colleagues have said that the biggest flaw in their polling was the failure to predict the demographic composition of the electorate. Broadly speaking, the people who showed up to vote on November 6 were younger and less white than Team Romney anticipated, and far more Democratic as a result. “The Colorado Latino vote was extraordinarily challenging,” Newhouse told me. “As it was in Florida.”

This point can be overstated. For example, New Hampshire and Iowa are both predominantly white states, and Obama won both whites and older voters in each of them. Likewise, whatever the challenges of polling Latinos, they were only 14 percent of the electorate in Colorado. It would be a stretch to say they explain most of the error in a Romney poll that was off by 8 percentage points overall in the state.

Still, the data I obtained did reveal symptoms of the “compositional” problem Newhouse cites. For example, Newhouse asked voters how interested they were in the election on a scale of 1 to 10, then kept track of how Romney was faring against Obama among those who were most interested (that is, the 8s, 9s, and 10s). In the chart below, I’ve displayed the final Obama-Romney margins for people who described themselves as 8-10s, along with those who described themselves as 10s:

What’s striking is how much better Romney does among those with the greatest interest in the campaign. If you look at Colorado and New Hampshire in particular, Romney is running up big margins among even the 8-10s, which Newhouse said routinely accounted for 80-90 percent of the sample in his internal polling. (In New Hampshire, the 8-10s represented 88 percent of the sample.) Newhouse said the reason the campaign broke out these numbers is that it helped them “try to gauge intensity.” But it also led them astray—it led them to assume that voter intensity was driving Romney’s leads. And it reflected a flaw in their polls. The people who told the campaign they were 8s, 9s, or 10s were a smaller share of the November 6 electorate than the 80-90 percent they accounted for in Romney’s polls--partly because Newhouse and his colleagues underestimated the number of young people, African Americans, and Latinos who wound up voting.

The second big problem with Romney’s internal polls has to do with the supposed momentum I alluded to earlier. Newhouse told me his numbers showed Romney stalling out around the time of Hurricane Sandy the week before the election, then recovering in the final few days of the race. “We thought we had in the last 72 hours of campaign … made up some ground from the challenging messaging period during the hurricane,” he said. It was the kind of momentum that could have made Ohio look doable even though Romney’s internal poll showed him down two points over the weekend. With the wind at their backs, even Pennsylvania may have seemed realistic with a three-point deficit Sunday night.

In some cases, the momentum appeared to be rather stark. Newhouse told me that the poll the campaign took in New Hampshire on Thursday, November 1, showed Romney down 45-48. On Sunday, it showed him up 50-43—a ten-point swing. New Hampshire turned out to be an especially volatile state, as Newhouse mentioned. And even without that, numbers often jump around arbitrarily on any given day. “You rule out any huge movement. It just doesn’t work that way,” said Newhouse. But, he conceded, “You begin to think maybe there is some movement” in the face of these kinds of numbers. “We had good earned media.” Indeed, even if you take two-day averages, Romney was down 1.5 points in New Hampshire after Thursday’s poll, according to Newhouse, but up 3.5 after Sunday’s poll—a five-point uptick from the post-Sandy low-point.

In retrospect, of course, there wasn’t any momentum to speak of, at least not toward Romney. How is it that Newhouse’s polls detected momentum nonetheless? One Democratic pollster I spoke with offered the following theory: During the final days of this campaign, only the most loyal partisans were picking up their phones when pollsters called—everyone else seemed to have had enough. (The pollster notes that this isn’t a general feature of campaigns; it just happened to be true of this one.) That would have exaggerated the influence of partisans generally. And if, on top of that, your poll already skewed toward Romney, then it would have amplified the Republican partisans even more than the Democratic ones and produced the appearance of momentum.

Newhouse rejected the theory when I suggested it. “There’s no evidence to indicate that’s true, that only partisans pick up the phone [late in the campaign],” he said, adding, “I’d argue we didn’t have much of a house effect [i.e., unexplained skew].” When pressed on why many of his final numbers showed an erroneous uptick for Romney, he offered that “it may be a function of Sunday polling”—a valid concern given that many pollsters are wary of polling on weekends.

Whatever the case, it’s clear that Romney’s closest aides and confidants interpreted the numbers quite literally. One Romney aide told me that he ran into Tagg Romney, the candidate’s eldest son, as the results came in on election night. “He looked like he was in a complete state of shock,” the aide said. “[As if] these numbers cannot be real.”  

Author's note: Special thanks to TNR's Nate Cohn for his exceptionally valuable insights. Any mistakes here are my own, and almost certainly because I didn't follow a piece of his advice. 

Update: Credit where due: CNN's Peter Hamby had a similar (if less detailed) set of numbers in his well-done report the day after the election. Apologies for the oversight. 

SHARE YOUR THOUGHTS

Show all 23 comments

You must be a subscriber to post comments. Subscribe today.

23 comments

Scheiber is way too kind to these people, who basically drank their own Kool-aid. Typical of the right-wing in its bubble. There were a large number of public polls and the people with brains, notably Nate Silver and the Princeton Election Project, have made the point time and again that the poll average, even without weighting of any kind, is a far more reliable guide than any single poll, including your own. If your polls diverge significantly from that average, you ought to be questioning your own polling and not insisting that the poll average is wrong, as these people did. The latter is possible, but far less likely. What Newhouse should have been doing was examining his own polling with a fine tooth comb to see what was going wrong. The fact is that they didn't care to. Beyond the fantasy that Romney wanted to enjoy until the end, they probably knew that they were done and that there was nothing really that they could do about it. They told themselves a pretty story so that they could carry on to the end without being utterly demoralized. It made them look foolish, but there really wasn't any downside. The election was over at the beginning of September, barring some sort of extraordinary reversal. That very nearly happened with the first debate. But when Romney's surge came to a stop on Oct 12 and slowly started to turn the other way, the moment had passed without Romney breaking through. Oct 12 was his high-water mark. That alone foretold that he was doomed. Beyond all that, by the end you didn't need to average the polls to see what was going on. All you had to do was look at the color. There was by then a sea of blue poll results in the states that mattered. Nick Silver didn't perform a magic act to call all the states correctly. He just read carefully the data that were there for all to see. Romney and his people wanted a fairy tale. So they made the assumptions necessary to give it to themselves. What would be much more interesting than this piece would be an explanation as to why the national polls were off and why they diverged so from the state polls. Secondarily, it would be interesting to know why there is systematic bias at Gallup and Rasmussen.

- roidubouloi

November 30, 2012 at 1:10am

You must be a subscriber to post comments. Subscribe today.

Roi is right. Romney and the Repubs were/are insane on their economic plan for any recovery and wishful-thinking deluded in their polling. They lost. Now we get to see if BHO and Senate Dems are still wishfull-thinking deluded on bipartisan economic solutions --- or that keeping some aspects of the filibuster is anything but a BIG mistake.

- drofnats1

November 30, 2012 at 7:35am

You must be a subscriber to post comments. Subscribe today.

I had assumed the Romney error was an assumption of a 2010 electorate over a 2008 electorate, which is hinted at as the compositional problem. You would think that much more would be written about this and that pollsters treat such failure as a rich mine of information. One way to look at the Romney polling is that it matched his tax plan and probably his selling technique. Get enough information to score the point you want and ignore the rest of the data on the theory that belief alone will rule the day.

- Nusholtz

November 30, 2012 at 8:43am

You must be a subscriber to post comments. Subscribe today.

Interesting. Even more interesting would be to see the Obama internal polling and then compare.

- timteeter

November 30, 2012 at 8:50am

You must be a subscriber to post comments. Subscribe today.

Well well well, The New Republic finally fixed my account - G*d intervened so ya'll wouldn't have to deal with me taking in the likes of Romney/Ryan the last several months. I lurked and you all did me proud and then some. Glad they lost, to put it mildly - although I look forward to openly tormenting the loathsome Paul Ryan for the rest of his miserable life. (I still feel joy every other day or so about the fact that the dark money creeps were completely tossed overboard, Koch Bros and Adleson and the like. Koch Bros even lost the judge races they tried to buy. Life is indeed good). Ah. Nice to be back :) As always, impossible to top Roi here. I will day that I can't figure out if Noam's secret source is just goofing on him or what. I certainly hope so. If these people really were this firmly ensconced in their silly liberal-media-blaming bubble, its just scary.

- WandreyCer

November 30, 2012 at 9:37am

You must be a subscriber to post comments. Subscribe today.

Seems to me this is an argument for the statisticians in the GOP to come up with a new metric for determining voter interest, and how to translate this to determining who will show up. Those "10s" for voter interest, I suspect, were people who growled and drooled when asked how interested they were. They were SUPER interested in getting that #%*& Obama sent back to Chicago, or Nairobi, or wherever he actually came from. Going forward, you might not want to pay too much attention to those people. They get to vote, and they will reliably vote, but in most jurisdictions they can only vote once. And in the end, they were outpolled by people who were still interested enough to show up, but clear-headed enough to recognize the line of hokum that the GOP was peddling.

- gwcross

November 30, 2012 at 10:12am

You must be a subscriber to post comments. Subscribe today.

My sense is that this time the truest fence-sitters, i.e., the ones who still don't know which way they're voting even as their hand grips the lever, were so queasy about a soul-less robot that they defied the "undecideds break for the challenger" rule.

- Mikelawyr22

November 30, 2012 at 10:12am

You must be a subscriber to post comments. Subscribe today.

Welcome back WandreyCer! As for the Romney campaign and its supporters - I read something recently (where?) about the airport in Boston being jammed up with private jets on election night. People had convinced themselves of victory. Now they seem to be in shock and denial, and have the chutzpah to behave as though they have won the election (see: fiscal cliff). I don't know if they're nuts or just very, very determined. But listening to rich guys telling us we have to do without SS and Medicare and/or work until age 105 is getting very old especially since we bailed out their failing businesses (especially, banks) which are now hoarding cash and paying workers too little to live on.

- Sophia

November 30, 2012 at 12:40pm

You must be a subscriber to post comments. Subscribe today.

hey wandrey, good to see you, sophia has stepped up pretty well in your place. One note of caution, the numbers above as to actual vote totals are not accurate as the votes have not yet been certified in a number of states. For instance Pa. at 52.1 vs. 46.7 is not yet official. New Hampshire officially is at 51.98% vs. 46.40% I only mention this because Obama is still racking up votes as provisional votes are counted. Right now Obama has a hefty 50.91% vs. 47.36% and a lead of around 4.5 million votes counted. (so rounded off it becomes 51 to the poetic justice of 47) Roid is right, I don't think it mattered either way (except thank God romney lost) if they drank their own kool aid or knew the score and decided to go fighting down to the end. I can't think of anything they could have done to win it (although telling the truth would have been nice at least once)

- blackton

November 30, 2012 at 1:07pm

You must be a subscriber to post comments. Subscribe today.

Wand: glad to have you back - thought you ran away just as I rejoined ;) ... “He looked like he was in a complete state of shock,” Poow wittow Tagg ... my heart bleeds. If he had not offered to slug the President of the United States for the offence of finally responding to the Romobot's lies and distortions, I might possibly have a smidgen of sympathy for the odious toad. As it is, the faster this self-entitled brood gets off the national stage - I hope it will take less time than the Palin's litter - the better. As for the substance of the article - just bear in mind that 47% of the people of this Republic voted for a self-described "businessman" and "entrepreneur" who hires people to read statistics who can't read statistics. The damage this oik would have done to the Republic is, based on the "internal polling" analysis set out above, self-evident. Fitting altogether that his first post-loss vacation was to Disney, asby all accounts he ran a Mickey Mouse operation.

- icarus-r

November 30, 2012 at 1:58pm

You must be a subscriber to post comments. Subscribe today.

I still amazed that Romney's campaign was so out of touch. This year seemed to be a mirror image of 2004, and the results were similar though Obama's margin is slightly higher. While I don't know how confident Kerry's campaign was in late October early Nov of 2004, I do think that the overconfidence of Republicans from George Will to Michael Barone to Romney suggests a difference between the parties. Democrats were, at best, nervous and cautiously hopeful in 2004, based on some polls showing a tightening race, but I remember no predictions of an easy victory. This year a lot of conservatives simply refused to consider a reality that did not line up with their desires. I also think that this confidence influenced some media coverage, which I felt seemed to suggest a toss-up or even slight Romney advantage in the face a consistent (albeit) narrow Obama lead in the swing states. The most glaring example was a WaPo article about Obama supposedly struggling in Defiance, Ohio in which there wasn't a single person quoted who wasn't voting the same way as they had in 2008, or Dickerson's Mittmentum article in Slate.

- PeteM

November 30, 2012 at 2:33pm

You must be a subscriber to post comments. Subscribe today.

Well put, Icarus. We've now had four consecutive presidential elections in which the GOP has relied on the picture of their candidate's level-headed competence, as opposed to those wild and wooly liberals in that there Democrat party. So we got two servings of Bush, a man who was notorious for his hostility toward structured, careful thought and his fact-free assessment of public issues. He went with his gut. No need to question WMD in Iraq, no need to question what happens in years 11-20 of an unbalanced tax cut. Then John McCain, whose leadership credentials were best displayed by a sanp judgement to select the most grossly inept and unqualified VP candidate in a lifetime. Good in a fighter plane at one point in his life, not so much at making thoughtful personnel decisions later in life. Isn't that one of those executive skills that we're supposed to be valuing in a businessman? And now, the uber-businessman Romney, whose grasp of numerical concepts such as "median income" was so loose that he evidently believed his own marketing propaganda. He didn't just drink the Kool Aid, he blended it himself. One military hero turned bumbler, and three delusional, wishful-thinking faux businessmen. I think I'll stick with the pot heads and eggheads for a few more election cycles.

- gwcross

November 30, 2012 at 2:51pm

You must be a subscriber to post comments. Subscribe today.

"Good in a fighter plane at one point in his life" Not really. He crashed four fighters - impetuous and undisciplined, a show-off with major daddy issues. Even then McCain was the oik he turned out to be.

- icarus-r

November 30, 2012 at 3:18pm

You must be a subscriber to post comments. Subscribe today.

Flawed polling, flawed messaging, flawed GOTV efforts, flawed campaign technology--Romney's was a pretty inept campaign, and the only reason the vote was as close as it was was because an historic flub by the incumbent in giving away the first debate. The GOP will learn--to an extent. They'll spend the money to put together a good ground game and tech game next time, and have already started assimilating a tone of moderation. But if they foolishly choose someone like Ryan over a Rubio, Christie, Martinez, or even Jindal next time, they'll flush it all away again.

- polcereal

November 30, 2012 at 3:58pm

You must be a subscriber to post comments. Subscribe today.

What Nusholtz said: "One way to look at the Romney polling is that it matched his tax plan and probably his selling technique. Get enough information to score the point you want and ignore the rest of the data on the theory that belief alone will rule the day." I can see the Powerpoint -- just pull the slides that could raise customer questions, and move directly to best case scenario. It's the same way Rummy et al. sold the Iraq war. Remember "cakewalk"?

- koppgeo

November 30, 2012 at 4:26pm

You must be a subscriber to post comments. Subscribe today.

PeteM, I agree about the difference between the parties, and would go even further -- "Democrats were, at best, nervous and cautiously hopeful" not just in 2004, but even THIS year, despite Obama's persistent lead for nearly the whole cycle. Conservatives seem to have a pathological need to see themselves as "winners," and liberals have a -- perhaps equally pathological -- tendency to see them that way too. It would be good if the recent outcome started to change this.

- Jeff_Smith

November 30, 2012 at 4:33pm

You must be a subscriber to post comments. Subscribe today.

Hello Wandrey, I was wondering where you'd gotten to. The old gang is mostly here, a year or so older and not much wiser (in my case at least). I think Newhouse's weirdest statement, as quoted by Noam, is that "the biggest flaw in their polling was the failure to predict the demographic composition of the electorate." To translate this as "dude we were, like, totally surprised that all those pesky non-white voters actually showed up at the polling places" would be doing it the favor of vernacular authenticity as well as suggesting something of the ideological myopia of Romney's team.

- ironyroad

November 30, 2012 at 5:36pm

You must be a subscriber to post comments. Subscribe today.

Interesting to hear the pollster say that people had had enough by the early days of November. In my NH household I was telling callers that very thing, that I had "had enough" and was not talking to them any more. I had never gotten to that stage before in 30 years of living in the first in the nation primary.

- calcio2000

November 30, 2012 at 6:26pm

You must be a subscriber to post comments. Subscribe today.

roi again is on the mark. It's important to note that any serious analysis needs to show not just why your side is right but also why the other side is in error. If you can't show flaws in the other side's methodology or reasoning, then there is no inherent reason to choose your own position over their position. All one can conclude is that somebody must be mistaken, and you can't assume that the error does not lie on your own side of the fence.

- dsimon

November 30, 2012 at 7:14pm

You must be a subscriber to post comments. Subscribe today.

The thing that boggles my mind is that the "compositional" issues were the basis of all of the "unskewed" public polling controversy and caused the public polling pros to explain that the composition wasn't an input but an OUTPUT, base on what respondents told them. It was never supposed to be a guess or assumption, but a part of the RESULT. Nate Silver explained this in at least a couple of blog entries. So how do all of these polling professionals from the right NOT get this??? This is just inconceivable to me - it sounds like they made EXACTLY the same error that the unskewed guy (Chambers?) made, but these guys should have known better.

- ramboorider

November 30, 2012 at 9:52pm

You must be a subscriber to post comments. Subscribe today.

And the Romney pollsters laughed all the way to the bank and live happily ever after. No matter how flawed their work, they still had a nice paycheck. I'm glad the country dodged the bullet that would have been aimed at the heart of our nation if these crooks were let loose on us. Just became a subscriber, and want to say hello to all.

- jdkinpa

November 30, 2012 at 11:58pm

You must be a subscriber to post comments. Subscribe today.

The master speaks to the issue: http://fivethirtyeight.blogs.nytimes.com/

- roidubouloi

December 1, 2012 at 9:07am

You must be a subscriber to post comments. Subscribe today.

http://www.latimes.com/news/politics/la-pn-romney-pollster-20121130,0,5125776.story?track=lat-pick "Mitt Romney pollster: Why we thought we would win" By James Rainey November 30, 2012, 11:58 a.m. [Currently a news.google Editor's Pick] Just think Noam Scheiber needs to know he was plagiarized by James Rainey: "Pre-election survey data that the Romney for President campaign shared with a reporter from the New Republic helps explain... Neil Newhouse, Romney’s chief pollster, told the magazine (its online reports appear at TNR.org): ..." TNR.org? Seems The New Republic brand is disappearing fast.

- K2K

December 1, 2012 at 5:28pm

You must be a subscriber to post comments. Subscribe today.

SHARE HIGHLIGHT

0 CHARACTERS SELECTED

TWEET THIS

POST TO TUMBLR

SHARE ON FACEBOOK

Close