Feb 23 2022

MPSDS and the JPSM Seminar Series: The Additional Effects of Adaptive Survey Design Beyond Post-Survey Adjustment: An Experimental Evaluation

Shiyu Zhang, Research Assistant and PhD Candidate, Michigan Program in Survey and Data Science

Wednesday, February 23
12pm to 1pm

Join via Zoom:
Join in Browser | Join via Zoom
Meeting ID: 97702415176
Meeting Passcode: 1070

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the well-established post-survey adjustment. This paper reports the results of an experiment that evaluated the additional effect of adaptive design to post-survey adjustments. The experiment was conducted in the Detroit Metro Area Communities Study in 2021. We evaluated the adaptive design in five outcomes: 1) response rates, 2) demographic composition of respondents, 3) bias and variance of key survey estimates, 4) changes in coefficients of regression model results, and 5) costs. The most significant benefit of the adaptive design was its ability to generate more efficient survey estimates with smaller variances and smaller design effects.