International Handbook of Survey methodology
It contains chapters on question writing, question testing, adapting questionnaires to
mode of data collection and much more. More information on the content at
http://www.xs4all.nl/~edithl/surveyhandbook/contents.htm
Contributed by Edith de Leeuw.
An Introduction to Survey Research and Data Analysis
by Herbert F. Weisberg, Jon A. Krosnick, and Bruce D. Bowen.
1989 Paperback (Scott, Foresman/Little, Brown Series in Political Science)
(with thanks to Jonathan Brill)
List compiled by Melissa Marcello.
Survey Research Methods - Recommended Articles/Books Delbert C. Miller Handbook of Research Design and Social Measurement Fifth Edition Sage,1991 Robert M. Groves and Mick P. Couper Nonresponse in household Interview Surveys Wiley,1998 James A. Davis Elementary Survey Analysis Prentice-Hall, Englewood Cliffs, NJ, 1971 Jean M. Converse Survey Research in the United States; Roots and Emergence 1890-1960 University of California Press, 1987 Samuel A Stouffer et al. Studies in Social Psychology in World War ll, priceton University Press, 1949-50 Paul B. Sheatsley and Warren J. Mitofsky, Eds. A Meeting Place: The History of the American Association for Public Opinion Research AAPOR, 1992 Survey Methodology. Groves, Fowler, Couper, Lepkowski, Singer and Tourangeau ISBN 0-471-48348-6 Likely the most comprehensive. This is the first edition and used for intro classes on survey methods. The sampling section may be challenging for those who are not probability driven. One of the few books that come with questions for homework assignments. Intro to survey quality. Biemer and Lyberg ISBN 0-471-19375-5 If you can expect some prior knowledge this is an excellent book focused on assessing and maintaining quality in survey research. Evaluation. Carol Weiss ISBN 0-13-309725-0 This book is extremely useful if your focus is on the conceptual nature of measuring something with intent. Written for anyone who needs to evaluate an intervention or treatment it covers the planning, design, collection, analysis, reporting and dissemination of results. Most survey methods books stop at analysis. Improving Survey Questions. Fowler ISBN 0-8039-4583-3 Covers design and evaluation of survey questions. Inexpensive and easy to read. I am using Dillman's "Mail and Internet Surveys: TDM" Eleanor Singer's POQ article on Human Subjects and Charlotte Steeh's article on non-response. Perhaps of help is the on-line book (free) that I wrote for a course I taught for the Spanish/Basque statistical agency. The text itself is a good review and I give several suggestions for reading at the end of each chapter, you can access it at http://www.eustat.es/prodserv/datos/sem44.pdf The other thing which is very helpful to start with is the brochure "what is a survey' by Fritz Scheuren. You can find that on web side of the American Statistical Association at www.amstat.org Earl Babbie's Social Research Methods is a very user-friendly text that I still refer to 17 years after taking a methods course. Paul D. Leedy and Jeanne Ellis Ormrod "Practical Research: Planning and Design" textbook. (1) Chapter 1 from Groves, Survey Errors and Survey Costs, Wiley 1989. Although this is a fairly technical treatment, it makes some really key points that can help survey researchers navigate or avoid what might otherwise be those difficult discussions where you feel like people are talking past each other about methods or exhibiting mistrust of survey methods. I like the identification of three fields that contributed much to survey methods and how their vocabularies and underlying assumptions regarding errors differ; the distinctions between describers and modelers, etc.; and the point that explicit formulations of cost-error tradeoffs are found in survey methods but rarely in other comparable fields (well, that last one might not be in that chapter, but I think it is). I might even think about having people read it at the start of the semester just to see what sticks, and again as the last reading in the course to see what has filled in. (2) Schwarz, Norbert. Questionnaire Design: The Rocky Road From Concepts to Answers. This is chapter 1 in Survey Measurement and Process Quality, Lyberg et al. (eds.), 1997, John Wiley and Sons. I think this is relatively easy reading, has very good references, covers a lot of practical considerations, and introduces the importance of cognitive theory in questionnaire design. I'd strongly suggest "Designing and Conducting Survey Research: A Comprehensive Guide" 2nd Edition by Rea and Parker (1997). Their 3rd edition is about to be published. The book is only 200 pages, gets straight to the point, and includes many examples from the authors own survey research company and experience as professors. Robinson, Matthew (2002). Mobocracy: How the Media's Obsession with Polling Twists the News, Alters Elections, and Undermines Democracy. In no uncertain terms, the author tells us why he doesn't like polls. Warren, Kenneth (2003). In Defense of Public Opinion Polling. This author, himself a pollster, counters the attacks, talks about good and bad polls, and tells you how to distinguish the two. I plan to use three of the Sage Publications: Practical Sampling (Henry), Telephone Survey Methods (Lavrakas) and Standardized Survey Interviewing (Fowler and Mangione). I usually teach an old article by Howard Schuman about anti-Vietnam war sentiment: "Two Sources of Antiwar Sentiment" American Journal of Sociology, 1972, 78 513-536. I like it because it shows how the same response to a question (do you support or oppose the war) can have several different underlying causes. It's also handy because the themes from the Vietnam war are still prevalent in the current war, but you can discuss them without appearing overtly political. Biemer, Paul P. and Lars E. Lyberg. 2003. Introduction to Survey Quality. Hoboken, NJ: John Wiley & Sons, Inc. (ISBN 0-471-19375-5.) Fink, Arlene and Jacqueline Kosecoff. 1998. How to Conduct Surveys: A Step-By-Step Guide. (Second Edition). Thousand Oaks, CA: SAGE Publication, Inc. (ISBN 0-7619-1409-9) Pew Research Center for the People and the Press - Polls Face Growing Resistance, But Still Representative Schueren - How Important Is Accuracy? Kalton - How Important Is Accuracy? Brackstonee - How Important Is Accuracy? Czaja and Blair - Selecting the Method of Data Collection Steele et al. - The Drop-Off/Pick-Up Method for Household Research Kaplowitz et al. - A Comparison of Web and Mail Survey Response Rates DeLeeuw and Collins - Data Collection Methods and Survey Quality Schwarz et al. - The Impact of Administration Mode on Response Effects in Survey Measurement Dillman et al. - Response Rate and Measurement Differences in Mixed Mode Surveys Scheuren - What Are Focus Groups? from the ASA What Is A Survey? Series Merton - The Focused Interview and Focus Groups: Continuities and Discontinuities Schwartz et al. - A Validity Assessment of Aggregation Methods for Multiple Key Informant Survey Data Jenkins and Dillman - Toward a Theory of Self-Administered Questionnaire Design Tourangeau et al. - Spacing, Position, and Order: Intrepretive Heuristics for Visual Features of Survey Questions Presser et al. - Methods for Testing and Evaluating Survey Questions Parker and Berman - Sample Size: More Than Calculations Sangster and Meekings - Data Concerns For Hard to Reach and Reluctant Respondents in Telephone Panel Surveys Teitler et al. - Costs and Benefits of Improving Response Rates for Hard-To-Reach Populations Taylor - Does Internet Research Work? Comparing Online Survey Results With Telephone Surveys Porter and Whitcomb - The Impact of Contact Type of Web Survey Response Rates Koch and Emrey - The Internet and Opinion Measurement: Surveying Marginalized Populations Heerwegh and Loosveldt - An Evaluation of the Effect of Response Formats on Data Quality in Web Surveys Couper et al. - Picture This! Exploring Visual Effects in Web Surveys American Association for Public Opinion Research (AAPOR) - Code of Professional Ethics and Practices Singer et al. - Attitudes and Behavior: The Impact of Privacy and Confidentiality Concerns on Participation in the 2000 Census Zipp and Toth - She Said, He Said, They Said: The Impact of Spousal Presence in Survey Research Bibliography: Survey Methods (from Thomas Auden) "Whatever exists at all exists in some amount. To know it thoroughly involves knowing its quantity as well as its quality." E. L. Thorndike, 1918. Reading and Research List Allen, Mary J. and Yen, Wendy M. (2001). Introduction to measurement theory. Waveland Press, Inc. Alreck, Pamela L. and Settle, Robert B. (1994). The survey research handbook, 2nd ed. McGraw-Hill. Anastasi, Anne and Urbina, Susana (1996). Psychological testing, 7th ed. Prentice Hall. Babbie, Earl, R. (1990). Survey Research Methods (2nd Ed.). Wadsworth Publishing. Campbell, Donald T. (2001). Social measurement. Sage publications. Carmines, Edward G. and Zeller, Richard A. (1979). Reliability and validity assessment. Quantitative applications in the social sciences, Vol. 17. Thousand Oaks, CA: Sage Publications. Converse, Jean M. and Presser, Stanley (1986). Survey questions: handcrafting the standardized questionnaire. Thousand Oaks, CA: Sage Publications. Crocker, Linda and Algina, James (1986). Introduction to classical and modern test theory. Harcourt Brace College Publishers. DeVellis, R. F. (2003). Scale development: theory and applications, 2nd ed. Thousand Oaks, CA: Sage Publications. Dillman, Don A. (1999). Mail and internet surveys, 2nd ed. Wiley. Dunteman, George H. (1989). Principal components analysis (quantitative applications in the social sciences). SAGE Publications. Fink, Arlene (editor) (2002). The survey kit (2nd Ed.). Thousand Oaks, CA: Sage Publications. Fink, Arlene (2003). How to sample in surveys, 2nd ed. Thousand Oaks, CA: Sage Publications. Fink, Arlene (2003). How to design survey studies, 2nd ed. Thousand Oaks, CA: Sage Publications. Folz, David H. (1996). Survey research for public administration. Sage Publications, Inc. Fowler, Floyd J., Jr. (1995). Improving survey questions: design and evaluation. Applied social research methods series Vol. 38, Thousand Oaks, CA: Sage Publications. Fowler, Floyd J., Jr. (2002). Survey research methods, 3rd ed. Applied social research methods series, Vol. 1, Thousand Oaks, CA: Sage Publications Green, Samuel B. and Salkind , Neil J. (2004). Using SPSS for Windows and Macintosh: analyzing and understanding data, 4th ed. Prentice Hall. Groves, Robert M. (et al) (2004). Survey methodology (Wiley Series in Survey Methodology). Wiley-Interscience. Hamilton, Lawrence C. (1992). Regression with Graphics: A Second Course in Applied Statistics, Brooks/Cole. Henry, G. T. (1990). Practical sampling. Thousand Oaks, CA: Sage Publications. Jolliffe, I. T. (2002). Principal component analysis, 2nd ed. Springer. Kelley, Debra (1998). Measurement, validity, and reliability. (http://www.longwood.edu/staff/kelleyds/Socl345/validity/). Longwood University. Kim, Jae-On and Mueller, Charles W. (1978). Factor analysis: statistical methods and practical issues (quantitative applications in the social sciences). SAGE Publications. Kim, Jae-On and Mueller, Charles W. (1978). Introduction to factor analysis : what it is and how to do it (quantitative applications in the social sciences). SAGE Publications. Kline, Paul (1994). An easy guide to factor analysis. Routledge. Litwin, M. S. (2003). How to assess and interpret survey psychometrics, 2nd ed., Thousand Oaks, CA: Sage Publications. Mertens, Donna M. (1998). Research methods in education and psychology. Sage Publications, Inc. Netemeyer, Richard G. and Bearden, William O. and Sharma, Subhash (2003). Scaling procedures. Sage Publications. Norusis, Marija J. (2002). SPSS 11.0 Guide to Data Analysis. Englewood Cliffs, NJ: Prentice Hall, Inc. O'Sullivan, Elizabethann and Gary R. Rassel. (2003). Research methods for public administrators (4th Ed.). Longman Publishers. Payne, Stanley (1980). The art of asking questions. Princeton University Press. Shultz, Kenneth S. and Whitney, David J. (2005). Measurement theory in action: case studies and exercises. Sage publications. Sudman, Seymour and Norman M. Bradburn. (1982). Asking questions: a practical guide to questionnaire design. Jossey-Bass Publishers. Tanaur, Judith M. (1994). Questions about questions: inquiries into the cognitive bases of surveys. Russell Sage Foundation. Thomas, S. J. ( 1999). Designing surveys that work. Thousand Oaks, CA: Corwin Press. Thompson, Bruce (2004). Exploratory and confirmatory factor analysis: understanding concepts and applications. American Psychological Association. Weisberg, Herbert and Krosnik, Jon A. and Bowen, Bruce D. (1996). An introduction to survey research, polling, and data analysis, 3rd edition, Sage Publications. Additional Information Sources Quantitative Applications in the Social Sciences, Sage Publications Applied Social Research Methods Series, Sage Publications Books listed on AAPOR's website: 1. Adorno, Theodor W., Else Frenkel-Brunswik, Daniel J. Lenvinson, and R. Nevitt Sanford. The Authoritarian Personality. Harper & Row, 1950. 2. Allport, Gabriel A., and Leo J. Postman. The Psychology of Rumor. Holt, 1947. 3. Almond, Gabriel A., and Sidney Verba. The Civic Culture: Political Attitudes and Democracy in Five Nations. Little Brown, 1965. 4. Berelson, Bernard, Paul F. Lazarsfeld, and William N. McPhee. Voting: A Study of Opinion Formation in a Presidential Campaign. Free Press, 1954. 5. Bogart, Leo. Silent Politics: Polls and the Awareness of Public Opinion. Wiley, 1972. 6. Campbell, Angus, Phillip E. Converse, Warren E. Miller, and Donald E. Stokes. The American Voter. Wiley, 1960. 7. Cantril, Hadley. The Pattern of Human Concerns. Rutgers University Press, 1965. 8. Centers, Richard. The Psychology of Social Classes. Princeton University Press, 1949. 9. Coleman, James S., Elihu Katz, and Herbert Menzel. Medical Innovation: A Diffusion Study. Bobbs-Merrill, 1966. 10. Converse, Jean M. Survey Research in the United States: Roots and Emergence, 1890-1960. University of California Press, 1987. 11. Dahl, Robert A. Who Governs? Democracy and Power in an American City. Yale University Press, 1961. 12. Deming, W. Edwards. Some Theory of Sampling. Wiley, 1950. 13. Dillman, Don A. Mail and Telephone Surveys: The Total Design Method. Wiley, 1978. 14. Festinger, Leon, Henry W. Riecken, and Stanley Schachter. When Prophecy Fails: A Social and Psychological Study. University of Minnesota Press, 1956. 15. Groves, Robert M. Survey Errors and Survey Costs. Wiley, 1989. 16. Hansen, Morris H., William N. Hurwitz, and William G. Madow. Sample Survey Methods and Theory. Wiley, 1953. 17. Hovland, Carl I., Arthur A. Lumsdaine, and Frederick D. Sheffield. Experiments on Mass Communication. Princeton University Press, 1949. 18. Hyman, Herbert H., with William J. Cobb, Jacob J. Feldman, Clyde W. Hart, and Charles Herbert Stember. Interviewing in Social Research. University of Chicago Press, 1954. 19. Inglehart, Ronald. The Silent Revolution: Changing Values and Political Styles among Western Publics. Princeton University Press, 1977. 20. Kahn, Robert L., and Charles F. Cannell. The Dynamics of Interviewing: Theory, Technique, and Cases. Wiley, 1957. 21. Katz, Elihu and Paul F. Lazarsfeld. Personal Influence; the Part Played by People in the Flow of Mass Communication. Free Press, 1955. 22. Key, V. O., Jr. Public Opinion and American Democracy. Knopf, 1961. 23. Kish, Leslie. Survey Sampling. Wiley, 1965. 24. Klapper, Joseph T. The Effects of Mass Communication. Free Press, 1960. 25. Lang, Gladys Engel, and Kurt Lang. The Battle for Public Opinion: President, Press, and Polls during Watergate. Columbia University Press, 1983. 26. Lasswell, Harold D., and Nathan Leites. The Language of Politics. Stewart, 1949. 27. Lazarsfeld, Paul F., Bernard Berelson, and Hazel Gaudet. The People's Choice. 2nd ed. Columbia University Press, 1948. 28. Lazarsfeld, Paul F., and Wagner Thielens Jr. The Academic Mind. Free Press, 1958. 29. Lerner, Daniel. The Passing of Traditional Society. Free Press, 1958. 30. Lipset, Seymour M. Political Man: The Social Bases of Politics. Doubleday, 1960. 31. Merton, Robert K., with Marjorie Fiske and Alberta Curtis. Mass Persuasion: The Social Psychology of a War Bond Drive. Harper, 1946. 32. Meyer, Philip. Precision Journalism: A Reporter's Introduction to Social Science Methods. Indiana University Press, 1973. 33. Mosteller, Frederick, Herbert Hyman, Philip J. McCarthy, Eli S. Marks, and David B. Truman. The Pre-election Polls of 1948. Social Science Research Council, 1949. 34. Mueller, John E. War, Presidents, and Public Opinion. Wiley, 1973. 35. Noelle-Neumann, Elisabeth. The Spiral of Silence: Public Opinion, Our Social Skin. Piper, 1980; reprint, University of Chicago Press, 1984. 36. Page, Benjamin I., and Robert Y. Shapiro. The Rational Public: Fifty Years of Trends in Americans' Policy Preferences. University of Chicago Press, 1992 37. Patterson, Thomas E., and Robert D. McClure. The Unseeing Eye: The Myth of Television Power in National Politics. Putnam, 1976. 38. Payne, Stanley L. The Art of Asking Questions. Princeton University Press, 1951. 39. Riesman, David, with Reuel Denney and Nathan Glazer. The Lonely Crowd. Yale University Press, 1950. 40. Rokeach, Milton. The Nature of Human Values. Free Press, 1975. 41. Schramm, Wilbur L. Responsibility in Mass Communication. Harper, 1957. 42. Schuman, Howard, and Stanley Presser. Questions and Answers in Attitude Surveys. Academic Press, 1981. 43. Sherif, Carolyn, Muzafer Sherif, and Roger E. Nebergall. Attitudes and Attitude Change. Saunders, 1965. 44. Smith, M. Brewster, Jerome S. Bruner, and Robert W. White. Opinions and Personality. Wiley, 1956. 45. Stephan, Frederick F., and Philip McCarthy. Sampling Opinions. Wiley, 1958. 46. Stouffer, Samuel A. Communism, Conformity, And Civil Liberties. Doubleday, 1955. 47. Stouffer, Samuel A., Edward A. Suchman, Leland C. DeVinney, Shirley A. Star, and Robin M. Williams Jr. Vol. 1, The American Soldier: Adjustment during Army Life; and Samuel A. Stouffer, Arthur A. Lumsdaine, Marion Harper Lumsdaine, Robin M. Williams Jr., M. Brewster Smith, Irving L. Janis, Shirley A. Star, and Leonard S. Cottrell. Vol. 2, The American Soldier: Combat and Its Aftermath. Princeton University Press, 1949. 48. Sudman, Seymour, and Norman M. Bradburn. Response Effects in Surveys. Aldine, 1974 49. Turner, Charles F., and Elizabeth M. Martin, eds. Surveying Subjective Phenomena. Russell Sage, 1984. 50. Zeisel, Hans. Say It with Figures. Harper, 1947.Resource links