Suchergebnisse

In this paper, we investigate the context stability of questions on political issues in cross-national surveys. For this purpose, we conducted three replication studies (N1 = 213; N2 = 677; N3 = 1,489) based on eight split-ballot design experiments with undergraduate and graduate students to test for question order effects. The questions, which were taken from the Eurobarometer (2013), included questions on perceived performance and identification. Respondents were randomly assigned to one of two experimental groups which received the questions either in the original or the reversed order. In all three studies, respondents answered the questions about Germany and the European Union/Europe differently depending on whether the question was asked first or second in the question sequence. Specifically, when answering a subsequent question in a question sequence, the preceding question seems to have functioned as a standard of comparison. Our empirical findings also suggest that the likelihood of the occurrence of such context effects can be reduced by implementing informed questionnaire design strategies.

Political knowledge can affect measures obtained in public opinion research and political science. When asked political knowledge questions, some respondents look up the answers online, inflating political knowledge scores. This response behavior is detectable in web surveys using paradata. This study investigates whether and to what extent respondents switch away from the survey to search for answers online using JavaScript OnBlur functions. Respondents were randomly assigned to device types (PC or smartphone) and response formats (open or closed) and answered a self-report question. The results reveal that about 30 percent of the respondents look up answers, depending on the device type and response format. They also reveal that switching away and correct answers are significantly associated with the response format. These findings provide new insights on looking up answers online and show that paradata are a promising new method to detect response behavior that may lead to incorrect inferences about respondents' political knowledge. The findings also show that paradata and self-reports complement each other and that both measures should be combined in future web surveys measuring political knowledge.