Nearly seven months after President Obama won reelection by a margin of 4 percentage points, the Gallup Organization, the world's best-known polling firm, identified in a new report four main reasons why their 2012 surveys badly understated Obama's support. The report, unveiled at a Tuesday morning event at the firm's headquarters in Washington, detailed the reasons why Gallup believes that its polls failed to predict Obama's victory. Gallup's final pre-election poll showed Mitt Romney leading Obama by a percentage point, 49 percent to 48 percent. But in the previous survey -- conducted immediately before Hurricane Sandy disrupted pollsters' plans in the week before the election -- Romney held a 5-point lead, 51 percent to 46 percent. Gallup editor-in-chief Frank Newport framed Gallup's struggles in terms of public polling's overall inability to accurately predict the results. The final RealClearPolitics average of national polls showed Obama leading Romney by just seven-tenths of a percentage point, around 3 points less than his actual margin. "Something was going on that affected the entire industry," Newport said. "That's what prompted our commitment here at Gallup." But Gallup itself was a part of the reason that national poll averages were inaccurate. Gallup's polls exhibited a consistent Republican bias in 2012; meanwhile, Gallup and some other firms, like the automated pollster Rasmussen Reports, are overrepresented in averages because they conduct daily tracking polls in the months prior to the election, rather than more infrequent media pollsters that didn't skew as heavily toward the Republican candidate. There is little precedent for review Gallup's process, and the implications for the firm's future -- and survey research at large -- could be far-reaching. "Political polling is the public face of survey research," said Michael Traugott, a University of Michigan professor who joined Newport and Gallup methodologists to lead the project. "And we know that confidence in the method and the image of the entire industry are related to how well the pre-election pollsters do." Traugott later stressed that election forecasting is not the be-all, end-all of public polling. "The purpose of the industry is not to estimate the outcome of elections per se," he said. Polls also explain how voters feel about the candidates and the issues -- and how and why their opinions may change over time. But elections provide a check on the accuracy of this data, consumers of polls certainly have more confidence in research that proves to be accurate. This is particularly important for Gallup, whose historical trends make up a large share of what we know know about how Americans have felt about their government and its role over time. The way opinions have changed on social and economic issues is based in part on their past surveys. The Gallup report outlined the various experiments it has conducted or will conduct later this year. While most research failed to identify factors "that caused Gallup to underestimate Obama's vote share," as the report puts it, the report does identify four main areas warranting changes, or further study. "None of these factors are large in and of themselves," said Newport. "But they are significant enough that we think they made a significant difference in our overall assessment in who was going to win the presidential election last fall." -- Likely-voter screen: Gallup's likely-voter screen, the battery of seven questions it uses to determine which respondents are most likely to cast ballots, "probably needs a total overhaul," Newport said Tuesday in a curtain-raising appearance on MSNBC's "Morning Joe." The Gallup postmortem calls their likely-voter model "broadly similar to those of other survey organizations," though they say that their questions "are more heavily weighted toward past voting behavior than other firm's questions." The report found the question seemingly most responsible for tilting their poll too far toward Romney was asking respondents how much thought they were giving to the election. Obama led by 3 percentage points among all voters, but that swung 4 points toward Romney among voters identified by Gallup as likely to cast ballots. "Obviously if we had used no questions, Obama would have led by 3 points," and Gallup would have been more accurate, Newport added. "We don't have a silver bullet" for explaining what part or parts of the likely-voter screen led to misrepresentation of the overall electorate, said Christopher Wlezien, a Temple University professor who consulted on the project. Traugott said it's possible the Obama campaign's focus on battleground states requires a different approach to identifying likely voters in those states. "Polling firms don't organize the geography of the samples by focusing on battleground states versus non-battleground states, he said," but turnout "actually was up" in these states, despite national declines. "One of the interesting things about this is whether or not this is a factor that is idiosyncratic to the 2012 campaign" and a testament to the Obama campaign's skill and efficiency in turning out their voters in battleground states, Traugott said. Newport said that Gallup would begin experiments including questions about voters' contact with the campaigns as part of the likely-voter screen. And since it's too early to begin using a likely-voter screen for the 2014 midterm elections, Gallup will undertake experiments this fall to test tweaks, using this year's gubernatorial elections in Virginia and New Jersey as test cases. Their pre-election poll results will not be released publicly, however, until after those elections. -- Residency of respondents: According to the report, Gallup conducted too many interviews with respondents in the Central and Mountain time zones, thus underrepresenting some areas of the Eastern and Pacific time zones, including areas of the Pacific coast in which Obama performed well. "This ... we think was a factor" in "our too-Romney estimate," Newport said. -- Race and ethnicity: The subject of a long story last year by the Huffington Post's Mark Blumenthal, Gallup acknowledged that the way they asked respondents about their race was causing them to weight their surveys to a population with more whites and fewer nonwhites. By asking a series of yes/no questions for each race and ethnicity category, Gallup ended up with "a disproportionate number of respondents reporting they were multiracial" or American Indian, the report states. Gallup has already implemented changes, allowing respondents to choose from a list of races and ethnicities -- and to select up to 5 choices. Results are then weighted to four known, Census-based targets, instead of the two to which results were weighted in 2012. "We think we've come much closer to the Census categories to which were weighting," Newport said. "Those changes have already been implemented in the first two months of this year." Newport also said their final poll was a percentage point low for Hispanic respondents, though he said the firm conducted an appropriate number of Spanish-language interviews. "Most of the interviews we conducted in Spanish ended up not being included in our likely-voter sample," Newport said, because those respondents who requested to complete interviews in Spanish were less likely to vote. More http://www.nationaljournal.com/blog...allup-post-mortem-leads-to-polling-changes-04