For many household surveys in the United States, responses rates have been steadily declining for at least the past two decades. A similar decline in survey response can be observed in all wealthy countries. Efforts to raise response rates have used such strategies as monetary incentives or repeated attempts to contact sample members and obtain completed interviews, but these strategies increase the costs of surveys. This review addresses the core issues regarding survey nonresponse. It considers why response rates are declining and what that means for the accuracy of survey results. These trends are of particular concern for the social science community, which is heavily invested in obtaining information from household surveys. The evidence to date makes it apparent that current trends in nonresponse, if not arrested, threaten to undermine the potential of household surveys to elicit information that assists in understanding social and economic issues. The trends also threaten to weaken the validity of inferences drawn from estimates based on those surveys. High nonresponse rates create the potential or risk for bias in estimates and affect survey design, data collection, estimation, and analysis. The survey community is painfully aware of these trends and has responded aggressively to these threats. The interview modes employed by surveys in the public and private sectors have proliferated as new technologies and methods have emerged and matured. To the traditional trio of mail, telephone, and face-to-face surveys have been added interactive voice response (IVR), audio computer-assisted self-interviewing (ACASI), web surveys, and a number of hybrid methods. Similarly, a growing research agenda has emerged in the past decade or so focused on seeking solutions to various aspects of the problem of survey nonresponse; the potential solutions that have been considered range from better training and deployment of interviewers to more use of incentives, better use of the information collected in the data collection, and increased use of auxiliary information from other sources in survey design and data collection. Nonresponse in Social Science Surveys: A Research Agenda also documents the increased use of information collected in the survey process in nonresponse adjustment.
Similarly, a growing research agenda has emerged in the past decade or so focused on seeking solutions to various aspects of the problem of survey nonresponse; the potential solutions that have been considered range from better training and deployment of interviewers to more use of incentives, better use of the information collected in the data collection, and increased use of auxiliary information from other sources in survey design and data collection. Nonresponse in Social Science Surveys: A Research Agenda also documents the increased use of information collected in the survey process in nonresponse adjustment". --Publisher's description.
Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
Category: Social Science
Although people in the United States have historically been reasonably supportive of federal censuses and surveys, they are increasingly unavailable for or not willing to respond to interview requests from federalâ€"as well as privateâ€"sources. Moreover, even when people agree to respond to a survey, they increasingly decline to complete all questions, and both survey and item nonresponse are growing problems. In March 2016, the National Academies of Sciences, Engineering, and Medicine convened a workshop to consider the respondent burden and its challenges and opportunities of the American Community Survey, which is conducted by the U.S. Census Bureau. This publication summarizes the presentations and discussions from the workshop.
Survey Methodology is becoming a more structured field of research, deserving of more and more academic attention. The SAGE Handbook of Survey Methodology explores both the increasingly scientific endeavour of surveys and their growing complexity, as different data collection modes and information sources are combined. The handbook takes a global approach, with a team of international experts looking at local and national specificities, as well as problems of cross-national, comparative survey research. The chapters are organized into seven major sections, each of which represents a stage in the survey life-cycle: Surveys and Societies Planning a Survey Measurement Sampling Data Collection Preparing Data for Use Assessing and Improving Data Quality The SAGE Handbook of Survey Methodology is a landmark and essential tool for any scholar within the social sciences.
Provides new insights into the accuracy and value of online panels for completing surveys Over the last decade, there has been a major global shift in survey and market research towards data collection, using samples selected from online panels. Yet despite their widespread use, remarkably little is known about the quality of the resulting data. This edited volume is one of the first attempts to carefully examine the quality of the survey data being generated by online samples. It describes some of the best empirically-based research on what has become a very important yet controversial method of collecting data. Online Panel Research presents 19 chapters of previously unpublished work addressing a wide range of topics, including coverage bias, nonresponse, measurement error, adjustment techniques, the relationship between nonresponse and measurement error, impact of smartphone adoption on data collection, Internet rating panels, and operational issues. The datasets used to prepare the analyses reported in the chapters are available on the accompanying website: www.wiley.com/go/online_panel Covers controversial topics such as professional respondents, speeders, and respondent validation. Addresses cutting-edge topics such as the challenge of smartphone survey completion, software to manage online panels, and Internet and mobile ratings panels. Discusses and provides examples of comparison studies between online panels and other surveys or benchmarks. Describes adjustment techniques to improve sample representativeness. Addresses coverage, nonresponse, attrition, and the relationship between nonresponse and measurement error with examples using data from the United States and Europe. Addresses practical questions such as motivations for joining an online panel and best practices for managing communications with panelists. Presents a meta-analysis of determinants of response quantity. Features contributions from 50 international authors with a wide variety of backgrounds and expertise. This book will be an invaluable resource for opinion and market researchers, academic researchers relying on web-based data collection, governmental researchers, statisticians, psychologists, sociologists, and other research practitioners.
The American Community Survey (ACS), to be run by the Census Bureau, will be a large (250,000 housing units a month), predominantly mailout/mailback survey that will collect information similar to that on the decennial census long form. The development of this new survey raises interesting questions about methods used for combining information from surveys and from administrative records, weighting to treat nonresponse and undercoverage, estimation for small areas, sample design, and calibration of the output from this survey with that from the long form. To assist the Census Bureau in developing a research agenda to address these and other methodological issues, the Committee on National Statistics held a workshop on September 13, 1998. This report summarizes that workshop.
This volume, a companion to Evaluating Welfare Reform in an Era of Transition, is a collection of papers on data collection issues for welfare and low-income populations. The papers on survey issues cover methods for designing surveys taking into account nonresponse in advance, obtaining high response rates in telephone surveys, obtaining high response rates in in-person surveys, the effects of incentive payments, methods for adjusting for missing data in surveys of low-income populations, and measurement error issues in surveys, with a special focus on recall error. The papers on administrative data cover the issues of matching and cleaning, access and confidentiality, problems in measuring employment and income, and the availability of data on children. The papers on welfare leavers and welfare dynamics cover a comparison of existing welfare leaver studies, data from the state of Wisconsin on welfare leavers, and data from the National Longitudinal Survey of Youth used to construct measures of heterogeneity in the welfare population based on the recipient's own welfare experience. A final paper discusses qualitative data.
Federal household surveys today face several significant challenges including: increasing costs of data collection, declining response rates, perceptions of increasing response burden, inadequate timeliness of estimates, discrepant estimates of key indicators, inefficient and considerable duplication of some survey content, and instances of gaps in needed research and analysis. The Workshop on the Future of Federal Household Surveys, held at the request of the U.S. Census Bureau, was designed to address the increasing concern among many members of the federal statistical system that federal household data collections in their current form are unsustainable. The workshop brought together leaders in the statistical community to discuss opportunities for enhancing the relevance, quality, and cost-effectiveness of household surveys sponsored by the federal statistical system. The Future of Federal Household Surveys is a factual summary of the presentations and related discussions that transpired during the workshop. This summary includes a number of solutions that range from methodological approaches, such as the use of administrative data, to emphasis on interagency cooperative efforts.
Key Methods in Geography is an introduction for undergraduates to the principal methodological issues involved in the collection, analysis and presentation of geographical information. It provides an accessible primer, which will be used by students as a reference throughout their degree, on all issues from research design to presentation. A unique feature of the book is that it provides definitions of terms from both human geography and physical geography. Organized into four parts: Getting Started in Geographical Research; Data Collection in Human Geography; Data Collection in Physical Geography; Analyzing and Representing Geographical Data. Each chapter is comprised of a short definition, a summary of the principal arguments, a substantive 5,000-word discussion, the use of real-life examples, and annotated notes for further reading. The teaching of research methods is integral in all geography courses. Key Methods in Geography identifies the key analytical and observational strategies with which all geography undergraduates should be conversant.
The Social Security Administration (SSA) is engaged in redesigning its disability determination process for providing cash benefits and medical assistance to blind and disabled persons under the Social Security Disability Insurance (SSDI) program and the Supplemental Security Income (SSI) program (Title II and Title XVI of the Social Security Act). The agency has undertaken a multiyear research effort to develop and test the feasibility, validity, reliability, and practicality of the redesigned disability determination process before making any decision about its national implementation. Survey Measurement of Work Disability reviews and provides advice on this research. One of the major areas for review is the ongoing independent, scientific review of the scope of work, design, and content of the Disability Evaluation Study (DES) and the conduct of the study by the chosen survey contractor. This report identifies statistical design, methodological, and content concerns and addresses other issues as they arise.