Suchergebnisse

Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in an experiment of three distinct survey designs implemented in the German sample of the European Values Study: a single-mode face-to-face design, a mixed-mode mail/web design, and a shorter (matrix) questionnaire in the mixed-mode design. We compare measurement quality in different ways, including differences in distributions across several data quality indicators as well as equivalence testing over 140 items in 25 attitudinal scales. We find similar data quality across the survey designs, although the mixed-mode survey shows more item nonresponse compared to the single-mode survey. Using equivalence testing we find that most scales achieve metric equivalence and, to a lesser extent, scalar equivalence across the designs.

Abstract
Mixing multiple modes of survey data collection has become standard practice in survey research. Mixed-mode surveys are faced with a slew of design decisions regarding which types of modes to administer and which sequence to administer them in. Such decisions are largely based on administrative objectives, such as minimizing costs and maximizing response rates. However, just as important to these mixed-mode decisions is their impact on nonresponse bias, measurement error bias, and total bias, which are understudied issues in the mixed-mode literature. In this article, we report on a sequential mixed-mode experiment of young adult drivers randomized to one of two mode sequences: an interviewer-administered (telephone) mode with self-administered (mail) follow-up, or the reverse sequence. Using a mix of direct and indirect bias estimation strategies, we find support for the notion that implementing a second mode of data collection can reduce nonresponse and measurement error bias, but the sequence in which the modes are administered makes a difference: the mail-telephone sequence minimizes bias to a greater extent than the telephone-mail sequence, relative to the starting mode and overall. However, a backfiring effect was found: despite reducing both nonresponse and measurement error bias, switching from mail to telephone increased the total bias in a key estimate of traffic accidents. A discussion of these findings and their implications for survey practice are provided in conclusion.

Digital trace data are receiving increased attention as a potential way to capture human behavior. Nevertheless, this type of data is far from perfect and may not always provide better data compared to traditional social surveys. In this study we estimate measurement quality of survey and digital trace data on smartphone usage with a MultiTrait MultiMethod (MTMM) model. The experimental design included five topics relating to the use of smartphones (traits) measured with five methods: three different survey scales (a 5- and a 7-point frequency scale and an open-ended question on duration) and two measures from digital trace data (frequency and duration). We show that surveys and digital trace data measures have very low correlation with each other. We also show that all measures are far from perfect and, while digital trace data appears to have often better quality compared to surveys, that is not always the case.

AbstractIt is well known that police recorded crime data is susceptible to substantial measurement error. However, despite its limitations, police data is widely used in regression models exploring the causes and effects of crime, which can lead to different types of bias. Here, we introduce a new R package ('rcme': Recounting Crime with Measurement Error) that can be used to facilitate sensitivity assessments of the impact of measurement error in analyses using police recorded crime rates across a wide range of settings. To demonstrate the potential of such sensitivity analysis, we explore the robustness of the effect of collective efficacy on criminal damage across Greater London's neighbourhoods. We show how the crime reduction effect attributed to collective efficacy appears robust, even when most criminal damage incidents are not recorded by the police, and if we accept that under-recording rates are moderately affected by collective efficacy.

Nonprobability online panels are commonly used in the social sciences as a fast and inexpensive way of collecting data in contrast to more expensive probability-based panels. Given their ubiquitous use in social science research, a great deal of research is being undertaken to assess the properties of nonprobability panels relative to probability ones. Much of this research focuses on selection bias, however, there is considerably less research assessing the comparability (or equivalence) of measurements collected from respondents in nonprobability and probability panels. This article contributes to addressing this research gap by testing whether measurement equivalence holds between multiple probability and nonprobability online panels in Australia and Germany. Using equivalence testing in the Confirmatory Factor Analysis framework, we assessed measurement equivalence in six multi-item scales (three in each country). We found significant measurement differences between probability and nonprobability panels and within them, even after weighting by demographic variables. These results suggest that combining or comparing multi-item scale data from different sources should be done with caution. We conclude with a discussion of the possible causes of these findings, their implications for survey research, and some guidance for data users.

The autumn of 1933 marked a festive moment for the city of Craiova, a royal visit made by King Carol II and Prince Nicolae with the aim of celebrating a series of local events such as: the consecration of St. Dumitru's Church, the inauguration of the "Carol al II-lea" Stadium as well as the celebration of 100 years of existence of the "Carol I" High School. The local authorities treated the event carefully, the preparation for October 26, 1933 involved a great effort. The day turned out to be a real success. Although a short visit of only one day, it was full of solemn events. The moment of October 26, 1933 remained recorded as an important day for the history of Craiova.

These data come from several web surveys among the German population 18 years and older who live in Germany and were eligible to vote in the 2021 federal election. Respondents were recruited from the German nonprobability online panel of Respondi/Bilendi.

In August of 2021, members of the online panel were invited through a survey-router system. For Wave 1 (30.8.2021-7.9.2021), 3,530 people were invited to the survey and 2,221 ended the survey successfully. For Wave 1B (8.9.2021-14.9.2021), only respondents from Wave 1 who reported owning a smartphone were invited. 1,803 completed the survey. For Wave 2 (14.9.2021-20.9.2021), 3,761 individuals were invited of which 2,451 completed the survey. For Wave 3 (27.9.2021-4.10.2021), 3,565 individuals were invited and 2,261 completed the survey. For Wave 4 (01.12.2021-16.12.2021), 1,945 individuals were invited and 1,092 completed the survey. The full data set includes 2,756 individuals who completed at least one of the four survey waves. For a detailed view of the longitudinal response structure, variables indicating participation in each wave are part of the dataset.

Quotas for gender, age, and state (Bundesland) were employed to generate a sample with sufficient diversity.

The questionnaire included items on political attitudes, voting preferences, political identities, news media consumption on- and offline, smartphone and social media use. The questionnaire was programmed in EFS Survey. Respondents could complete the questionnaire on a PC, tablet or smartphone.

These data come from several web surveys among the German population 18 years and older who live in Germany and were eligible to vote in the 2021 federal election. Respondents were recruited from the German nonprobability online panel of Respondi/Bilendi.

In August of 2021, members of the online panel were invited through a survey-router system. For Wave 1 (30.8.2021-7.9.2021), 3,530 people were invited to the survey and 2,221 ended the survey successfully. For Wave 1B (8.9.2021-14.9.2021), only respondents from Wave 1 who reported owning a smartphone were invited. 1,803 completed the survey. For Wave 2 (14.9.2021-20.9.2021), 3,761 individuals were invited of which 2,451 completed the survey. For Wave 3 (27.9.2021-4.10.2021), 3,565 individuals were invited and 2,261 completed the survey. For Wave 4 (01.12.2021-16.12.2021), 1,945 individuals were invited and 1,092 completed the survey. The full data set includes 2,756 individuals who completed at least one of the four survey waves. For a detailed view of the longitudinal response structure, variables indicating participation in each wave are part of the dataset.

Quotas for gender, age, and state (Bundesland) were employed to generate a sample with sufficient diversity.

The questionnaire included items on political attitudes, voting preferences, political identities, news media consumption on- and offline, smartphone and social media use. The questionnaire was programmed in EFS Survey. Respondents could complete the questionnaire on a PC, tablet or smartphone.

Crime research has grown substantially over the past decade, with a rise in evidence-informed approaches to criminal justice, statistics-driven decision-making and predictive analytics. The fuel that has driven this growth is data – and one of its most pressing challenges - is the lack of research on the use and interpretation of data sources. This accessible, engaging book closes that gap for researchers, practitioners and students. International researchers and crime analysts discuss the strengths, perils and opportunities of the data sources and tools now available and their best use in informing sound public policy and criminal justice practice