Episodes
-
Immersive simulations and war games are transforming how organizations make complex decisions and understand human behavior, with artificial intelligence now making these powerful tools more accessible than ever. By putting participants in realistic scenarios with emotional stakes, these games reveal blind spots in thinking, challenge assumptions, and build cognitive empathy across divides.
This episode features Daveed Gartenstein-Ross and Eleanor Ross of Valens Games, who discuss their work creating sophisticated political and national security simulations. They share insights on using AI to democratize game design, the importance of incorporating humor and humanity into serious scenarios, and how simulations can help bridge social divisions by encouraging participants to see issues from multiple perspectives. The conversation touches on applications ranging from academic teaching to corporate decision-making, highlighting how games create safe spaces for practicing high-consequence choices.
Resources
Crossing the Chasm by Geoffrey Moore https://a.co/d/5IJOIdS
War Game (Documentary) https://www.imdb.com/title/tt26681810/
Providence (Platform) https://playprovidence.io/
Acceleration (Game) https://valensglobal.com/what-we-do/simulations-hub/wargames-simulations/
Our Guests
Daveed Gartenstein-Ross is the founder and CEO of Valens Games, pioneering the use of immersive simulations and AI-powered game design in national security, politics, and organizational decision-making. A counterterrorism expert who previously led the drafting of the Department of Homeland Security's 2019 counterterrorism strategy, Gartenstein-Ross transitioned from teaching at Georgetown University's Security Studies Program to developing innovative educational gaming experiences that help participants challenge assumptions and think differently about complex challenges.
Eleanor Ross joined Valens Games after first experiencing their work as a student at Duke University, where she participated in and then team-led national security simulations. With a research background and plans to enter government service, Ross was drawn to Valens Games' unique approach to learning and now helps develop immersive exercises that build cognitive empathy and critical thinking skills. She specializes in creating engaging narratives and characters that make complex scenarios more approachable and meaningful for participants.
Your Host
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Subscribe to Cross Tabs
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
-
Despite decades of political polling and analysis, most voters know almost nothing about politics, policy, or current events - and traditional campaign strategies completely fail to account for this reality. The key to winning elections isn't policy positions or positive messaging, but rather effectively defining your opponent before they can define you.
Dr. Rachel Bitecofer, political analyst and author of Hit ‘Em Where It Hurts, joins Farrah Bostic to break down why Democratic campaign strategies are fundamentally flawed and what actually moves voters. Drawing from her experience as a pollster and strategist, Bitecofer explains how Republicans have mastered "negative partisanship" messaging while Democrats continue to waste resources on micro-targeting and policy-focused campaigns that don't reach or resonate with most voters. She argues that Democrats must adopt more effective branding and messaging strategies that speak to voters' immediate concerns and fears, rather than assuming an informed and engaged electorate that doesn't exist.
Resources
Hit 'Em Where It Hurts: How to Save Democracy by Beating Republicans at Their Own Game by Rachel Bitecofer - https://a.co/d/9gcRHxM
It Was All a Lie by Stuart Stevens - https://a.co/d/hDkoAoJ
Virginia Governor Poll Study (2019-2020) by Rachel Bitecofer - https://cnu.edu/wasoncenter/surveys/2019-10-07-va-leg-1/
Partisan Response Study by Rachel Bitecofer - https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3414607
The Next Level Podcast featuring Sarah Longwell - https://podcasts.apple.com/us/podcast/the-next-level/id1647085571
Blueprint Research - https://blueprint2024.com/about/
Our Guest
Rachel Bitecofer is a political analyst, strategist, and author of Hit Them Where It Hurts: How to Save Democracy by Beating Republicans at Their Own Game. After a career in academia where she taught political science and ran a survey research center, Bitecofer shifted to focus on reforming Democratic campaign strategy. Known for her theory of negative partisanship and accurate electoral predictions, she argues that traditional Democratic campaign approaches fundamentally misunderstand voter psychology and behavior.
Unlike conventional pollsters and analysts, she emphasizes that most voters are largely uninformed about politics and make decisions based on emotional triggers rather than policy positions. Bitecofer has worked with the Democratic National Committee to implement more effective messaging strategies and regularly provides commentary on political campaigns and electoral dynamics.
Your Host
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at
-
Missing episodes?
-
In this episode, Farrah talks to the Chair of the Harvard Public Opinion Project, Anil Cacodcar, about the origins and evolution of the Poll, which was started by students in 2000. We discuss the process the student team uses to develop survey questions, organize research topics, and partner with the Ipsos Knowledge Panel to reach young respondents.
We also discuss insights from the latest poll data, including a shift in enthusiasm among young Democrats after Kamala Harris joined the ticket, the gender gap in candidate perceptions, and the role of factors like candidate characteristics and social media in shaping youth opinion.
We also discussed challenges in measuring the impact of media consumption and events on young voters' opinions in the current information landscape, and get Anil's perspective on the future of youth polling and what he'll be watching for in the upcoming election.
Throughout the conversation, we explore the complexities of understanding and reaching the youth electorate, as well as the importance of qualitative research to complement polling data.
After the interview, Farrah shares some reflections on the last 2 weeks of the polling landscape — and why you should avert your gaze to other more pressing matters: like defending the votes that are already being cast.
Our Guest:
Anil Cacodcar, is an undergraduate student at Harvard and Chair of the Harvard Public Opinion Project, which runs the nation's largest poll on the political opinions and civic attitudes of young Americans. He studies both Economics and Human Developmental & Regenerative Biology.
Resources:
The latest Harvard Youth Poll
Harvard Public Opinion Project
"Americans under 21 first voted 50 years ago. It didn’t go as expected." The Washington Post
US Elections Project
Your Host
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Subscribe to Cross Tabs
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
Political polling and forecasting are complex and fraught with uncertainty, yet they remain crucial tools for understanding elections and voter behavior. The challenge lies in accurately modeling likely electorates, communicating probabilities to the public, and interpreting correlations between issues and voting patterns.
In this episode, Farrah talks to John Sides, a political scientist and professor at Vanderbilt University. Sides discusses the difficulties in surveying young voters, the limitations of issue-importance questions in polls, and his ideal dataset for studying voter behavior across election cycles. He emphasizes the need for more nuanced interpretations of polling data and forecasts, urging us all to embrace uncertainty while still finding value in the data.
Good Authority
By John Sides:
'Another viral gender gap graph doesn’t tell the whole story’'What voters say is important doesn’t actually affect their vote'
Our GuestJohn Sides is a distinguished political scientist and professor in the Department of Political Science at Vanderbilt University. His research focuses on political behavior, public opinion, and the dynamics of American elections. Sides is also a co-founder of Good Authority, a publication that brings academic insights to bear on current political issues. Previously, he was a founding editor of The Monkey Cage, a popular political science blog that was later published by The Washington Post.
Sides is known for his data-driven approach to analyzing political trends and his ability to communicate complex political concepts to a general audience. He has authored several books on American politics and elections, including The Gamble and Identity Crisis, which examined the factors behind Donald Trump's 2016 election victory.
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
Quick production note: Farrah's audio gets better a couple of minutes into the recording. We have no idea what went wrong, but you'll only suffer for a few minutes before everyone sounds great. :)
In this episode, host Farrah Bostic explores the fascinating relationship between journalism and polling, inspired by the book Lost in a Gallup, with its author, Professor W. Joseph Campbell. We discuss the historical evolution of polling from its early days, marked by the Literary Digest's infamous 1936 failure, to the upstart methodologies of Gallup, Roper, and Crossley. The conversation highlights the love-hate relationship between journalists and pollsters, exploring the mutual benefits and tensions that have shaped their interactions over decades. We also examine major polling failures, including the 1948 Dewey-Truman election, and the complexities of modern polling methods. The episode emphasizes the human desire for prediction and the underlying challenges of accurately gauging public opinion in an ever-evolving media landscape.
Our GuestW. Joseph Campbell is a former newspaper and wire service journalist who reported from four continents in an award-winning twenty-year career. He is currently professor emeritus at American University's School of Communication, and is the author of Lost in a Gallup (2020), Getting It Wrong (2010, 2017), and 1995: The Year the Future Began (2015) among other works.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
This week we're taking a break from national polling to talk about polling done by a group trying hard to influence the outcome of various races this cycle: crypto bros. The influence and agenda of the crypto industry is lurking behind a lot of the candidates and their policy positions. Crypto PACs are raising and spending over $100 million on 2024 races. It's in crypto's interests to portray itself as representing a large voting bloc who will vote based on a candidate's position on crypto — via industry-funded polls making claims about American's crypto behavior and beliefs. They seem to be cutting through: the RNC adopted an entire plank of crypto-industry pet positions into their party platform.
Who better to talk through these polls, PACs, and policy positions than cryptoresearcher Molly White. She joins me to break down the way the industry is trying to persuade through polls, and why we need more journalists and politicos to bring a much higher level of scrutiny to industry polling.
ResourcesCitation Needed - a newsletter featuring explainers of developments in the cryptocurrency industry. We talked about this article.Web3 Is Going Great - a project to track examples of blockchains/crypto/web3 technology projects that aren't going very well.Follow the Crypto"The Black Investors Who Were Burned by Bitcoin", The AtlanticPew Research report on cryptoAdam Tooze on crypto & the GOP
Our guestMolly White is a researcher, software engineer, and prominent critic of cryptocurrencies and blockchain-based projects. She is best known for her website Web3 is Going Just Great, which documents only some of the many disasters in the cryptocurrency and web3 industries, and for her Follow the Crypto election spending tracker.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Subscribe to Cross Tabs Apple PodcastsSpotifySubstack
-
Forecasting election outcomes involves far more than simple polling averages, often incorporating complex models that account for candidate strengths, voter demographics, and historical trends. While these models strive for accuracy, they must grapple with the inherent unpredictability of human behavior and the challenge of quantifying intangible factors like voter enthusiasm and candidate quality.
In this episode of Cross Tabs, Farrah Bostic interviews Lakshya Jain, a co-founder of the elections blog Split Ticket. Jain offers insights into the intricacies of election modeling, discussing the limitations of polls, the importance of cross-tabs, and the value of embracing uncertainty in forecasts. He also touches on the recent shift from Joe Biden to Kamala Harris as the Democratic presidential nominee, exploring how this change has reshaped polling data and electoral predictions.
ResourcesSplit Ticket: https://split-ticket.org
Split Ticket's Presidential Polling Aggregator
We Dug Into the 2024 Polling Crosstabs. What We Found Was Stunning. (Lakshya Jain and Harrison Lavelle in Politico)
How #electiontwitter took over the political prediction game (Financial Times)
How The Times/Siena Poll Is Conducted (The New York Times)
Pollster Ratings (FiveThirtyEight)
Silver Bulletin 2024 presidential election forecast
Our GuestLakshya Jain is a machine learning engineer who analyzes political data in his free time. He handles modeling, data pieces, and presidential ratings for Split Ticket. Jain graduated from UC Berkeley with a BA in 2019 and an MS in 2020, majoring in computer science. He currently works in the tech industry. His political analysis and writing have appeared in prominent publications such as The New York Times, Sabato's Crystal Ball, and The Bulwark.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Subscribe to Cross TabsDon't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
America's political landscape is deeply divided into two distinct nations, shaped by historical, economic, and cultural forces that extend far beyond simple demographics. This divide manifests in vastly different lived experiences, policy preferences, and institutional structures between red and blue states, with profound implications for the future of American democracy and governance.
In this episode of Cross Tabs, Farrah Bostic interviews Mike Podhorzer, a political strategist and data analyst, to discuss Podhorzer's excellent analysis of The Two Americas, examining how factors like regional factionalism, economic models, religious institutions, and labor unions have contributed to the current political polarization. The conversation covers the limitations of traditional polling methods, the role of exogenous events in shaping political alignments, and the potential for collective action to address systemic issues in American politics.
"The Limits of Education Essentialism" by Mike Podhorzer
"The Two Nations of America" by Mike Podhorzer
"As Go Unions, So Goes America" by Mike Podhorzer
Know Your Enemy podcast episode The Bomb Power
Cook Political Report podcast episode What Polls Miss - And What We Should Focus On Instead
Mike Podhorzer is a renowned political strategist and data analyst with decades of experience in labor politics and progressive causes. He served as the longtime political director of the AFL-CIO, where he pioneered innovative approaches to voter mobilization and data-driven campaigning.
Podhorzer is widely recognized for his insightful analysis of American political trends, particularly his work on the "Two Americas" concept, which examines the deep structural divides in U.S. politics. His writing and research have contributed significantly to understanding the complexities of modern American political landscapes beyond traditional polling metrics.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
In this post-nominating conventions episode, I reflect on lessons learned as we approach the last 60 days before the election. Some key themes include:
How not to be a crosstab trutherWhy elections aren't really that much like marketsHow forecasts predict the pastWhy campaigns don't need one single message to win the whole thingAnd what you should do with your energy and effort if you're not using forecasts to earn a living.Tune in to gain a nuanced understanding of polling, forecasting, and political marketing as we head towards the election.
There are 69 days to the 2024 election.
Recommended Reading:"Mad Poll Disease Redux: Harris-Walz Edition" Weekend Reading by Mike Podhorzer
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts 0Spotify
-
Polling data and turnout models are far more complex than most people realize, with numerous factors influencing their accuracy and interpretation. From the challenges of non-response bias to the intricacies of early voting analysis, understanding election forecasts requires a nuanced approach beyond simple percentages.
In this episode of Crosstabs, Farrah speaks with Dr. Michael McDonald, a professor of political science at the University of Florida. Dr. McDonald, known for producing the country's voter turnout rates, shares his expertise on the complexities of polling methodologies, the impact of demographic shifts on voting patterns, and the critical need for standardized election data collection across the United States. The conversation covers a wide range of topics, including the limitations of voter files, the challenges of predicting turnout, and the potential benefits of a national identity card for solving voter registration issues.
Voter Turnout Gap in Surveys
Performance of American Elections Survey
Election Lab at UF
Current Population Survey Voter and Registration Supplement
Cooperative Election Survey
US Election Project (Michael McDonald’s Substack newsletter)
Our Guest
Dr. Michael McDonald is a professor of political science at the University of Florida and a renowned expert on American elections. He is best known for producing the United States Elections Project, which provides the country's most authoritative voter turnout statistics.
Dr. McDonald's work on early voting patterns and election administration has been widely cited in academic research and media coverage. His expertise extends to redistricting, voting rights, and the analysis of precinct-level election data. With a career spanning decades, Dr. McDonald has become a go-to source for understanding the complexities of the American electoral system and voter behavior.
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple PodcastsSpotify
-
Public opinion polling has historically underrepresented Black Americans and other minority groups, leading to skewed perceptions of national sentiment. Emotional responses to political issues and candidates play a crucial role in shaping voter behavior, yet are often overlooked in traditional survey methods.
Dr. Camille Burge-Hicks, Associate Professor of Political Science at Villanova University, discusses the evolution of political polling and its impact on Black communities. She shares insights on the importance of qualitative research in understanding voter motivations, the need to update outdated survey measures, and the potential for emotional factors to influence voters. The conversation also touches on the challenges of accurately representing diverse populations in polls and the responsibility of both pollsters and the public in interpreting survey results.
Polling and the Public by Herbert Asher
Historic Firsts by Evelyn Simien
The Philadelphia Negro by W.E.B. Du Bois and Isabel Eaton
National Survey of Black Americans
National Black Election Study
National Black Politics Study
Collaborative Multi-Racial Post-Election Study (CMPS)
Data Black Public Opinion Polls
Dr. Camille Burge-Hicks is an Associate Professor and Chair of the Department of Political Science at Villanova University. Her research focuses on political psychology, race and ethnicity in American politics, and the role of emotions in shaping political behavior. Dr. Burge-Hicks is particularly interested in exploring how group identities and emotional experiences influence public opinion and political decision-making among Black Americans and other minority groups. Her forthcoming book, Fired Up, Ready to Go: Pride, Shame, and Anger in Black Politics, examines the intersection of emotions and racial identity in political engagement.
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
Federal statistical agencies play a crucial role in providing objective, high-quality data that inform policy decisions, resource allocation, and business strategies across the United States. However, these agencies face significant challenges, including budget constraints, declining response rates, and the need to modernize data collection methods while maintaining data integrity and privacy.
In this episode, Farrah interviews Connie Citro, a senior scholar at the National Academies of Sciences, Engineering, and Medicine. Citro discusses the findings from a recent report, "The Nation's Data at Risk," which assesses the health of federal statistical agencies. She explains the historical development of these agencies, their importance in providing reliable data for both public and private sectors, and the potential consequences of underfunding and political interference. The conversation covers topics such as data sharing between agencies, the impact of non-response on survey quality, and the need for greater public awareness of federal statistics' value.
Resources The Nation's Data at Risk National Health and Nutrition Examination Survey (NHANES) Fundamental Principles for Official Statistics Census Project Principles and Practices for a Federal Statistical Agency
Our GuestConnie Citro is a distinguished expert in federal statistics with over four decades of experience in the field. She served for many years as the director of the Committee on National Statistics at the National Academies of Sciences, Engineering, and Medicine, where she now continues as a senior scholar. Throughout her career, Citro has been involved in numerous studies on critical statistical issues, including decennial census methodologies, poverty measurement, and the American Community Survey. Her extensive knowledge and experience make her a leading voice in discussions about the health and future of the U.S. federal statistical system.
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify... -
Immersive gaming exercises offer a powerful tool for understanding complex geopolitical scenarios and developing strategic empathy. They provide insights that traditional analysis often misses. By inhabiting different perspectives and grappling with real-world constraints, participants gain a deeper appreciation for the multifaceted nature of global challenges and decision-making processes.
In this episode of Crosstabs, Farrah talks to Daveed Gartenstein-Ross and Amal Ali of Valens Games about their innovative approach, going beyond wargaming and scenario planning to more immersive strategic experiences. They discuss how their exercises help leaders break free from cognitive biases, explore alternative futures, and gain insight into complex political and social dynamics. We talk about the potential applications of these techniques to the current political situation, offering listeners a fresh perspective on analyzing and preparing for uncertain futures.
ResourcesInfluence by Robert Cialdini
Ezra Klein's episode on an open Democratic convention:
Sarah Longwell's The Focus Group at The Bulwark
Valens Games war games
Our GuestsDaveed Gartenstein-Ross
Daveed Gartenstein-Ross is the founder and CEO of Valens Games. He is a practitioner, scholar, and entrepreneur whose career has focused on analyzing complex 21st-century challenges and forging laudable solutions to them. Daveed is also the author or volume editor of over 30 books and monographs, including Enemies Near and Far (Columbia University Press, 2022), which examines ISIS and al-Qaeda’s processes of engaging in organizational learning. He is on the faculty at Carnegie Mellon University and Duke University.
Amal Ali
Amal Ali serves as the Senior Vice President of Strategy at Valens Games, where she specializes in engaging with government and public sector clients. Her career spans military service, intelligence work, and strategic consulting. Ali is a military veteran with experience in the U.S. intelligence community, including work at the agency level and supporting Army and joint special operations. Ali's background in intelligence analysis, coupled with her cross-cultural understanding, informs her approach to game design and facilitation at Valens Games. In her role, she focuses on developing immersive exercises that help decision-makers gain new perspectives on complex geopolitical challenges.
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience in research and strategy for B2B and B2C companies, Farrah helps business leaders make big decisions. Connect with Farrah on LinkedIn.
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
Political polling, especially among minority communities hasn't always had a great track record of representation, and of deep understanding of racial dynamics and ways different communities interact with ideas of civic participation. This conversation explores how allegiance to one's country and sense of belonging shape political participation, challenging more simplistic ideas about what kinds of participation matter, and why people do it.
Dr. Ray Block, a professor at Penn State who also studies "truth decay" at the RAND Corporation, brings his expertise in social identity and political involvement to the discussion. He shares insights on the evolving landscape of polling, the importance of community-focused research, and the role of protest in American democracy. Together we explore the nuances of political engagement, offering a fresh perspective on how we understand and measure civic participation.
Resources
Dr Block's Allegiance and Belonging Study
Google’s work on “Understanding America’s Interested Bystander”
Presentation at Personal Democracy Forum 2015African American Research Collaborative: https://africanamericanresearch.us/
Our Guest
Ray Block Jr., Ph.D., is senior research advisor for the African American Research Collaborative. He has led their research design on a range of polls, including research involving elections, health policy, and African Americans’ policy goals. Block is also the Brown-McCourtney Endowed Career Professor at the McCourtney Institute for Democracy and associate professor of Political Science and African American Studies at Pennsylvania State University. Block received his B.A. in philosophy and political science from Howard University and his Ph.D. in political science from The Ohio State University.
Your Host
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Subscribe to Cross Tabs
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts SpotifySign up for our newsletter at crosstabspod.substack.com to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
-
The shadowy world of online survey fraud threatens to undermine market research. Sophisticated scammers exploit programmatic sample systems lacking fraud controls to skew results. As the industry grapples with this growing problem, researchers must adopt new technologies and partnerships to ensure data quality and maintain trust.
In this episode of Crosstabs, host Farrah Bostic continues her conversation with Rich Ratcliff, Chief Trust Officer at Opinion Route. They discuss the challenges of detecting and preventing survey fraud in the digital age, the importance of choosing the right sample partners, and the potential impact of AI – both positively and negatively – on research. Ratcliff emphasizes the need for researchers to embrace new technologies and partnerships to combat fraud while maintaining the human element in market research. Researchers will want to hear Ratcliff’s valuable advice on how to navigate the evolving landscape of online surveys and data collection to ensure our careful designs aren’t undermined by fraudulent respondents.
Resources
ResTech Landscape Map: https://www.restecher.com/landscape/
"The Sample Bubble in the Form of a Conference Recap" https://www.opinionroute.com/blog/samplecon-2024-highlights-2-2/
"Securing the Survey Link": https://www.opinionroute.com/dataquality/securing-the-survey-link-2/
Our Guest
Rich Ratcliff is the Chief Trust Officer at OpinionRoute, a company that delivers accurate data by utilizing expertise in online survey sampling and proprietary technology solutions to simplify research processes, which enables clients to scale and researchers to stay ahead in a dynamic and competitive market.
Your Host
Farrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Stay Connected
Cross Tabs website & newsletter: https://www.crosstabspodcast.com
Sign up for our newsletter to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
Subscribe to Cross Tabs
Don't miss an episode! Subscribe to Cross Tabs on your favorite podcast platform:
Apple Podcasts Spotify
-
The multi-billion dollar online survey industry is rife with fraud, from individual survey hackers to sophisticated crime rings, exploiting the system for profit. Uncover the hidden world of survey fraud and learn how misaligned incentives, fragmented processes, and technological innovations meant to improve feasibility have led to an present threat of bogus respondents and invalid data.
In this riveting episode of Cross Tabs, guest Rich Ratcliff, Chief Trust Officer at OpinionRoute, joins host Farrah Bostic to expose the seedy underbelly of the market research industry. Rich shares his extensive knowledge gleaned from 30 years in the business, including firsthand experience interviewing survey fraudsters. Together, they explore the evolution of sampling methods, the unintended consequences of programmatic sampling, and the critical importance of data quality in an era of widespread survey fraud.
ResourcesInside the Minds of Survey Fraudsters — Fascinating videos from Ratcliff's interviews with survey hackers about their techniquesISO 20252 - https://www.iso.org/news/ref2369.html — The research ISO for quantitative research, which is 50 pages long and important for understanding data qualityInsights Association — Data Integrity Initiative OpinionRoute — an online survey operations company that helps market researchers eliminate the operational surprises and delays that disrupt projects using a blend of technology and human expertise.
Our GuestRich Ratcliff is the Chief Trust Officer at OpinionRoute, a company that delivers accurate data by utilizing expertise in online survey sampling and proprietary technology solutions to simplify research processes. This enables clients to scale and researchers to stay ahead in a dynamic and competitive market.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at https://www.thedifferenceengine.co/ , a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Website & newsletter: https://www.crosstabspodcast.com -- Sign up for our newsletter to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
-
Political polling operates in a landscape shaped by evolving methodologies, true demographic shifts, and the challenges of capturing accurate data in the digital age. What sample source you draw from, what sample frame you use, how you design your survey questions — all of it can affect the outcome of a survey.
In this episode, Farrah Bostic speaks with Andrew Mercer, a senior research methodologist at the Pew Research Center. Mercer shares his expertise on the intricacies of political polling, including the rise of mixed-method surveys, the impact of bogus responding in online, opt-in sample, the nuances of question design, and the importance of transparency. The conversation offers valuable insights for anyone seeking to navigate the world of political polling (or other survey research) with a more critical eye.
ResourcesNational Public Opinion Reference Survey – Pew Research
Study on PartyID by Pew Research Center
How Public Opinion Polling Has Changed in the 21st Century - Pew Research
Online opt-in polls can produce misleading results, especially for young people and Hispanic adults - Pew Research
Our GuestAndrew Mercer is a senior research methodologist at Pew Research Center. He is an expert on probability-based online panels, nonprobability survey methods, survey nonresponse, and statistical analysis. His research focuses on methods of identifying and correcting bias in survey samples. He leads the Center's research on nonprobability samples and co-authored several reports and publications.
He also served on the American Association for Public Opinion Research's task force on Data Quality Metrics for Online Samples. He has authored blog posts and analyses, making methodological concepts such as margin of error and oversampling accessible to a general audience.
Prior to joining the Center, Mercer was a senior survey methodologist at Westat. He received a bachelor's degree in political science from Carleton College and a master's and doctoral degrees in survey methodology from the University of Maryland. His research has been published in Public Opinion Quarterly and the Journal of Survey Statistics and Methodology.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into practical strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Website & newsletter: https://www.crosstabspodcast.com — Sign up for our newsletter to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
-
The battle for political salience is heating up as campaigns push competing narratives ahead of the 2024 election. But what do the latest polls really tell us about the mood of the electorate and the issues driving their vote?
In this episode of Cross Tabs, Aaron Zitner, editor and reporter in the Washington Bureau of the Wall Street Journal, joins host Farrah Bostic to discuss the Wall Street Journal's polling program. Zitner shares insights on the shifting coalitions, voter turnout patterns, and issue priorities that could decide the election, and offers advice on how to be a savvy consumer of polls in a highly unpredictable political environment.
ResourcesPoll: Election interest hits new low in tight Biden-Trump race (NBC News)Five Takeaways From the WSJ Swing-State Poll (Wall Street Journal)Survey of Consumers (University of Michigan)What Happened™ In 2022 (Catalist)Harvard Youth Poll
Our GuestAaron Zitner is a reporter and editor in The Wall Street Journal's Washington bureau, focusing largely on how politics are driven by demographic and economic change. He also reports on trends in polling. Earlier, he was the Journal's national politics editor.
Previously, Aaron was deputy chief of the Washington bureau for the Los Angeles Times, Chicago Tribune and other Tribune newspapers. He helped lead presidential campaign coverage for the Los Angeles Times and served as the paper’s White House and Washington economics editor.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at https://www.thedifferenceengine.co/ and connect with Farrah at https://www.linkedin.com/in/farrahbostic/.
Stay ConnectedWebsite & newsletter: https://www.crosstabspodcast.comSign up for our newsletter to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
-
In this episode of Cross Tabs, we delve into the complexities and limitations of public opinion polling with guest Mike Podhorzer. Mike, a seasoned political strategist with a rich history in the labor movement, most recently as former political director of the AFL-CIO, walks us through the weaknesses and blind spots of public polling. We touch on topics such as the differences between polling data and actual voting behavior, the flaws of national polls versus state by state or regional "ecosystem" polling, and how polling can distort public perception and affect campaign strategies. We also discussed the historical context and evolution of polling, highlighting key issues like the misinterpretation of voters' priorities and the psychological impact of polling on voter turnout. But it's not all bad news - Mike does offer insights into how polling can be improved and how better strategies can be employed in political campaigns.
Mentioned Resources:
"We Gave Four Good Pollsters the Same Raw Data. They Had Four Different Results." by Nate Cohn for The Upshot at the New York Times.
"Mad Poll Disease Redux" by Mike Podhorzer at Weekend Reading
"A Cure for Mad Poll Disease" by Mike Podhorzer at Weekend Reading
"The Newsroom is Not a Safe Space" by Ben Smith at Semafor
"Terrible Food and Such Small Portions" by Mike Podhorzer at Weekend Reading
You should definitely subscribe to Weekend Reading! Find it here: https://www.weekendreading.net/
And don't forget to subscribe to the Cross Tabs podcast at https://www.crosstabspodcast.com/
You can follow me on most social platforms at @farrahbostic
Or email me with questions or comments at [email protected]
Coming soon: a YouTube channel!!
-
Ever noticed public opinion pollsters talking about "matching survey respondents to the voter file"? No? Just me?
Pollsters use voter file data - public records about who voted - to identify registered and likely voters. This data is used to shape election strategies and predict outcomes. Our guest reveals how raw voter rolls are transformed into powerful tools for micro-targeting and predictive modeling that campaigns rely on.
In this episode of Cross Tabs, host Farrah Bostic and guest Paul Westcott, Executive Vice President at the political data firm L2, discuss the complex process of collecting, cleaning, and enriching voter data. Westcott shares fascinating insights into how L2 builds comprehensive voter profiles by combining public records with consumer data, enabling campaigns to identify and persuade key voter segments. The conversation also explores the challenges of polling methodology in an era of declining response rates.
Resources"Hacking the Electorate: How Campaigns Perceive Voters" by Eitan Hersh
"Race and ethnicity data for first, middle, and surnames" by Kosuke Imai
L2 Voter Mapping tool
LiveRamp
AAPOR (Association of Public Opinion Researchers)
Our GuestPaul Westcott is the Executive Vice President of Sales & Marketing at L2, where he has significantly expanded the company's footprint across various industries, including academia, consumer research, corporate government affairs, automotive, media, and B2C marketing. With over 300 U.S. Representatives and Senators utilizing L2, Paul has helped make the company the largest provider of constituent contact data to Congress. Prior to L2, Paul worked in media for NBC News, Fox News Channel, and iHeartMedia, where he created and hosted a daily talk show and podcast covering news and politics. Learn more about L2 at l2-data.com and connect with Paul on LinkedIn.
Your HostFarrah Bostic is the founder and Head of Research & Strategy at The Difference Engine, a strategic insights consultancy. With over 20 years of experience turning audience insights into effective strategies for B2B and B2C companies, Farrah helps business leaders make big decisions across various industries. Learn more at thedifferenceengine.co and connect with Farrah on LinkedIn.
Stay ConnectedWebsite & newsletter: crosstabspodcast.com
Sign up for our newsletter to receive exclusive content, episode highlights, and behind-the-scenes insights delivered to your inbox.
- Show more