In its troubled hour, polling could use an irreverent figure to reset expectations – Huron Daily Tribune
Posted By admin on November 11, 2020
(The Conversation is an independent and nonprofit source of news, analysis and commentary from academic experts.)
W. Joseph Campbell, American University School of Communication
(THE CONVERSATION) Polling is hardly a flamboyant field that attracts a lot of colorful characters. It is a rather reserved profession that now finds itself under siege in the aftermath of yet another polling surprise in a national election.
The field is buffeted by intense criticism by even extreme claims that it may be doomed following mischaracterizations in national polls that former Vice President Joe Biden was bound for a blowout victory.
Many preelection polls suggested it was to be a blue wave election in which Biden would easily take over the White House, while fellow Democrats would sweep to control in the Senate and fortify their majority in the House of Representatives.
The 2020 election was closer and more complex than most national polls indicated, and it marked the second successive polling surprise in a U.S. presidential election. In 2016, polls in key Great Lakes states underestimated support for Donald Trump, states that were crucial to his winning the White House.
In its troubled hour, polling could use a prominent, outspoken and irreverent character who knows the professions intricacies and whose default isnt to defensiveness. Such a figure could place pollings latest misstep in useful and plausible perspective, and do so candidly, without seeming too haughty or arcane about it.
To prove were not yellow
Polling has no such colorful, outspoken character now. It did once, in Burns (Bud) Roper, the Iowa-born son of a pioneer in modern survey research, Elmo Roper. Bud Roper was disarming enough to tell a newspaper reporter in the 1950s: I guess the main reason we do these election polls at all is to prove were not yellow, or cowardly.
Roper, who died in 2003, was in polling much of his adult life, entering his fathers market research firm after World War II. He retired as the companys chairman in 1994. He was around when the Roper poll dramatically miscalled the 1948 presidential election, predicting that Thomas E. Dewey would defeat President Harry Truman by 15 percentage points.
Truman won reelection by 4.5 points, which meant Ropers polling error was a staggering 19.5 percentage points almost as dreadful as the Literary Digest failure in 1936, when the venerable magazines mail-in survey erroneously pegged Alf Landon to unseat President Franklin D. Roosevelt by a wide margin.
The 1936 debacle occurred at the dawn of modern opinion research and, as I write in my latest book, Lost in a Gallup: Polling Failure in U.S. Presidential Elections, it left a legacy of nagging doubt about the effectiveness of polling in estimating election outcomes.
Nonetheless, it is also true that journalists, and the public, inevitably turn to polls and the illusion of precision they offer in seeking clarity about the dynamics of a presidential campaign. Even after the back-to-back embarrassments in 2016 and 2020, election polling is surely not destined for collapse or dissolution. Polling may be an unglamorous profession; it also is a hardy one.
Bud Ropers long career traced fairly well pollings entrenchment in American politics and culture. He once said that he entered the field when it was somewhere between a kooky off-the-wall and an established industry.
In some ways, Ropers most noteworthy contribution was candor and a refreshing disinclination to take survey research all that seriously. In that sense, he was like his father, who began conducting preelection polls in 1936 but came to doubt their value.
In the run-up to the 1948 election, for example, Elmo Roper equated polling to a stunt, like balancing cocktail glasses on top of each other or tearing a telephone book in two. Its impressive. It has a certain fascination. But it tells us very little that we wouldnt find out even if poll-taking had never been invented.
Bud Roper similarly tended toward colorful outspokenness. He was not hesitant to call out his profession for its shortcomings and flaws.
Largely art
In 1984, at a time when election polling was going through another rough patch, Bud Roper said in a speech to the American Association for the Advancement of Science, Our polling techniques have gotten more and more sophisticated, yet we seem to be missing more and more elections.
Roper was frank about some of pollings unresolved headaches, such as differentiating between likely and unlikely voters a determination crucial to a surveys accuracy.
One of the trickiest parts of an election poll is to determine who is likely to vote and who is not, Roper once said, adding with characteristic frankness, I can assure you that this determination is largely art.
The likely-voter conundrum remains a defiant and persistent problem. It also is an important reason that election polling is a blend of art and science, which Roper liked to emphasize. In fact, he said it tended to be more art than science.
I have heard it said that opinion research is half art and half science, Roper stated in an address to members of the American Association for Public Opinion Research at the close of his yearlong presidential term in 1983. I would say that a good deal more than half is art and correspondingly less than half is science.
Roper held some out-of-the-mainstream ideas about polling. He was not enamored with surveys conducted by telephone, noting they too often interrupted respondents and disrupted their routines. Roper argued, somewhat vaguely, a solution to the sharp decline in response rates to telephone surveys was to go back to personal interviews. Telephone wont do it, internet wont do it, email wont do it, he said late in his life.
He added: I dont have all the answers as to how, but if [the problem of declining response rates] is not solved, I think the industry as weve known it is going to be oh, itll survive, but its going to survive with worse and worse results every time we go up.
Taking responsibility for a bad poll
Roper was not one to sidestep controversy. He conceded error without hesitation when, in 1993, his company conducted a survey for the American Jewish Committee that suggested 22% of Americans doubted the Holocaust had occurred.
It was a surprising, controversial and off-target finding that Roper soon questioned, noting the questions wording included a double negative and should have been rephrased. When the question was revised and posed in a separate survey, only 1.1% of the respondents said they doubted the Holocaust.
[Deep knowledge, daily. Sign up for The Conversations newsletter.]
Roper said he regretted that the original polls finding served to misinform the public, to scare the Jewish community needlessly and to give aid and comfort to the neo-Nazis who have a commitment to Holocaust denial.
In saying so, Roper showed he could stand up and take responsibility for a bad poll. Its a lesson that has enduring relevance.
This article is republished from The Conversation under a Creative Commons license. Read the original article here: https://theconversation.com/in-its-troubled-hour-polling-could-use-an-irreverent-figure-to-reset-expectations-149810.
Originally posted here: