45 min
Theory of Change #005: Can polls be trusted? (With Courtney Kennedy of the Pew Research Center) Flux Podcasts (Formerly Theory of Change)
-
- Politics
If you read, listen or watch the news today it’s impossible to avoid public opinion polls. They are literally everywhere. The president’s approval rating, what people think about impeachment, even what the best fast food restaurant is.
But as omnipresent as opinion surveys are, a lot of the math and science that goes into them is relatively unknown to many people. There are also a lot of questions about how polls work and how they should work. Why do most polls include more Democrats than Republicans? Do political “independents” actually exist?
There are also a lot of misunderstandings about opinion surveys. Many people, think that they got the 2016 presidential election wrong. But that’s not quite true. In fact, the national polls did a pretty good job of predicting what the vote would be. But some of the state polls, did get it wrong, and the Constitution awards the presidency to the candidate with the most Electoral College votes—not the popular vote.
To get to the bottom of these issues, Theory of Change host Matthew Sheffield spoke with Courtney Kennedy, the director of survey research at the Pew Research Center. In the conversation, Kennedy talks at length about the profusion of survey research companies and the rise of polling aggregation operations like those at the FiveThirtyEight, RealClearPolitics, and the New York Times.
While she is skeptical about some pollsters’ practices, she also wonders whether it make sense to lump low-quality polls with those from organizations with much stricter standards.
She also warns that trying to create election forecasts that assign a candidate’s percentage chance of winning based on polls may actually suppress voter turnout.
Kennedy also discusses how polling operations have had to change how they conduct research in light of the rise of spam phone calls. One surprising change that the Pew Research Center has made is to go old-school by recruiting poll respondents via letters in their mailboxes.
MEMBERSHIP BENEFITS
The deep conversations we bring you about politics, religion, technology, and media take great time and care to produce. Your subscriptions make Theory of Change possible and we’re very grateful for your help.
Please join today to get full access with Patreon or Substack.
If you would like to support the show but don’t want to subscribe, you can also send one-time donations via PayPal.
If you're not able to support financially, please help us by subscribing and/or leaving a nice review on Apple Podcasts. Doing this helps other people find Theory of Change and our great guests.
ABOUT THE SHOW
Theory of Change is hosted by Matthew Sheffield about larger trends and intersections of politics, religion, media, and technology. It's part of the Flux network, a new content community of podcasters and writers. Please visit us at flux.community to learn more and to tell us about what you're doing. We're constantly growing and learning from the great people we meet.
Theory of Change on Twitter: https://twitter.com/TheoryChange
Matthew Sheffield on Mastodon: https://mastodon.social/@mattsheffield
Matthew Sheffield on Twitter: https://twitter.com/mattsheffield
This is a public episode. If you’d like to discuss this with other subscribers or get access to bonus episodes, visit theoryofchange.flux.community/subscribe
This is a public episode. If you’d like to discuss this with other subscribers or get access to bonus episodes, visit plus.flux.community/subscribe
If you read, listen or watch the news today it’s impossible to avoid public opinion polls. They are literally everywhere. The president’s approval rating, what people think about impeachment, even what the best fast food restaurant is.
But as omnipresent as opinion surveys are, a lot of the math and science that goes into them is relatively unknown to many people. There are also a lot of questions about how polls work and how they should work. Why do most polls include more Democrats than Republicans? Do political “independents” actually exist?
There are also a lot of misunderstandings about opinion surveys. Many people, think that they got the 2016 presidential election wrong. But that’s not quite true. In fact, the national polls did a pretty good job of predicting what the vote would be. But some of the state polls, did get it wrong, and the Constitution awards the presidency to the candidate with the most Electoral College votes—not the popular vote.
To get to the bottom of these issues, Theory of Change host Matthew Sheffield spoke with Courtney Kennedy, the director of survey research at the Pew Research Center. In the conversation, Kennedy talks at length about the profusion of survey research companies and the rise of polling aggregation operations like those at the FiveThirtyEight, RealClearPolitics, and the New York Times.
While she is skeptical about some pollsters’ practices, she also wonders whether it make sense to lump low-quality polls with those from organizations with much stricter standards.
She also warns that trying to create election forecasts that assign a candidate’s percentage chance of winning based on polls may actually suppress voter turnout.
Kennedy also discusses how polling operations have had to change how they conduct research in light of the rise of spam phone calls. One surprising change that the Pew Research Center has made is to go old-school by recruiting poll respondents via letters in their mailboxes.
MEMBERSHIP BENEFITS
The deep conversations we bring you about politics, religion, technology, and media take great time and care to produce. Your subscriptions make Theory of Change possible and we’re very grateful for your help.
Please join today to get full access with Patreon or Substack.
If you would like to support the show but don’t want to subscribe, you can also send one-time donations via PayPal.
If you're not able to support financially, please help us by subscribing and/or leaving a nice review on Apple Podcasts. Doing this helps other people find Theory of Change and our great guests.
ABOUT THE SHOW
Theory of Change is hosted by Matthew Sheffield about larger trends and intersections of politics, religion, media, and technology. It's part of the Flux network, a new content community of podcasters and writers. Please visit us at flux.community to learn more and to tell us about what you're doing. We're constantly growing and learning from the great people we meet.
Theory of Change on Twitter: https://twitter.com/TheoryChange
Matthew Sheffield on Mastodon: https://mastodon.social/@mattsheffield
Matthew Sheffield on Twitter: https://twitter.com/mattsheffield
This is a public episode. If you’d like to discuss this with other subscribers or get access to bonus episodes, visit theoryofchange.flux.community/subscribe
This is a public episode. If you’d like to discuss this with other subscribers or get access to bonus episodes, visit plus.flux.community/subscribe
45 min