Keeping surveys valid, reliable, and useful: a tutorial

Risk Anal. 2014 Aug;34(8):1362-75. doi: 10.1111/risa.12250. Epub 2014 Jul 15.

Abstract

This tutorial focuses on how to produce reliable and generalizable data from random-digit-dialing (RDD) landline and cell phone surveys. The article notes that RDD response rates have declined and explores the impact of this pronounced decline. The tutorial addresses order, response mode, and many other biases, sample size, cooperation and response rates, weighting, and hybrid designs-all using examples from risk analysis to illustrate the key points. The article ends with a brief review of the advantages and disadvantages of major Internet and paper surveys tools, and how these can be molded and sometimes combined in repeated, longitudinal, and other designs to answer questions about risk preferences and perceptions.

Keywords: Cooperation rate; phone surveys; reliability; response rate; sample size; survey biases; weighting.