Suchergebnisse

"Media, Electoral Accountability, and Issue Voting" published on by Oxford University Press.

AbstractManipulation checks are often advisable in experimental studies, yet they rarely appear in practice. This lack of usage may stem from fears of distorting treatment effects and uncertainty regarding which type to use (e.g., instructional manipulation checks [IMCs] or assessments of whether stimuli alter a latent independent variable of interest). Here, we first categorize the main variants and argue that factual manipulation checks (FMCs)—that is, objective questions about key elements of the experiment—can identify individual‐level attentiveness to experimental information and, as a consequence, better enable researchers to diagnose experimental findings. We then find, through four replication studies, little evidence that FMC placement affects treatment effects, and that placing FMCs immediately post‐outcome does not attenuate FMC passage rates. Additionally, FMC and IMC passage rates are only weakly related, suggesting that each technique identifies different sets of attentive subjects. Thus, unlike other methods, FMCs can confirm attentiveness to experimental protocols.

National newspapers regularly report on public opinion as part of their political coverage. In addition to covering aggregate survey trends, journalists occasionally conduct follow-up interviews with respondents from those surveys to present the views of real people in news stories. The practice of reporting these "qualitative quotes" has existed for decades, yet, there has been little scrutiny of the voices that appear in news stories or their effect on public opinion. We examine this phenomenon in the context of the United States with a historical examination of New York Times stories and other major U.S. outlets that contain polling information and follow-up interviews. Consistent with past work on exemplars, there is considerable evidence for the nonrandom nature of the people invited to comment for news stories. In particular, the use of qualitative quotes reinforces some of the biases that exist in news sourcing more generally. Finally, we demonstrate in an experiment that qualitative quotes influence policy attitudes as least as much as aggregate polling figures.