Validity of Survey Response Propensity Indicators: A Behavior Genetics Approach

In: Social science quarterly, Volume 94, Issue 2, p. 569-589

Abstract

ObjectivesThis study explains how behavior genetic analysis using a twin design can help us assess the validity of our measures.MethodsWe test multiple indicators of response propensity, a measure used by survey researchers to better understand the similarities and differences between survey respondents and nonrespondents. The response propensity indicators evaluated include response to follow‐up surveys and subsequent waves of a panel and the completion of a sensitive recontact information sheet to aid subsequent recontact efforts.ResultsA classical and the newly proposed method of validation all point to insufficient validity of our response propensity measures. Construct validation using data from the National Survey of Midlife Development in the United States exhibited little correlation between indicators. Genetic analysis suggests that the success of subsequent data‐collection efforts is predominantly driven by additive genetic effects, while nonresponse to inquiries for recontact information is influenced predominantly by familial environmental predictors.ConclusionOur results indicate that different underlying constructs drive the response propensity indicators, suggesting that nonresponse is, at minimum, multidimensional.