Quality of Life Research

, Volume 12, Issue 3, pp 219–227 | Cite as

Cognitive psychology and self-reports: Models and methods

  • Jared B. Jobe
Article

Abstract

This article describes the models and methods that cognitive psychologists and survey researchers use to evaluate and experimentally test cognitive issues in questionnaire design and subsequently improve self-report instruments. These models and methods assess the cognitive processes underlying how respondents comprehend and generate answers to self-report questions. Cognitive processing models are briefly described. Non-experimental methods – expert cognitive review, cognitive task analysis, focus groups, and cognitive interviews – are described. Examples are provided of how these methods were effectively used to identify cognitive self-report issues. Experimental methods – cognitive laboratory experiments, field tests, and experiments embedded in field surveys – are described. Examples are provided of: (a) how laboratory experiments were designed to test the capability and accuracy of respondents in performing the cognitive tasks required to answer self-report questions, (b) how a field experiment was conducted in which a cognitively designed questionnaire was effectively tested against the original questionnaire, and (c) how a cognitive experiment embedded in a field survey was conducted to test cognitive predictions.

Autobiographical memory Cognitive interviews Focus groups Information processing models 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtzman HS, Cain VS (eds). The Science of Self-report: Implications for Research and Practice. Mahwah, NJ: Erlbaum, 2000.Google Scholar
  2. 2.
    Rubin DC (ed). Autobiographical Memory. Cambridge, UK: Cambridge University Press, 1986.Google Scholar
  3. 3.
    Jobe JB, Mingay DJ. Cognition and survey measurement: History and overview. Appl Cognit Psychol 1991; 5: 175–192.Google Scholar
  4. 4.
    Jobe JB, Tourangeau R, Smith AF. Contributions of survey research to the understanding of memory. Appl Cognit Psychol 1993; 7: 567–584.Google Scholar
  5. 5.
    Sudman S, Bradburn N, Schwarz N. Thinking about Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass, 1995.Google Scholar
  6. 6.
    Tourangeau R, Rips LJ, Rasinski K. The Psychology of Survey Response. New York: Cambridge University Press, 2000.Google Scholar
  7. 7.
    Jobe JB, Herrmann DJ. Implications of models of survey cognition for memory theory. In: Herrmann D, Johnson M, McEvoy C, Hertzog C, Hertel P (eds), Basic and Applied Memory Research: Vol. 2. Practical Applications. Hillsdale, NJ: Erlbaum, 1996; 193–205.Google Scholar
  8. 8.
    Tourangeau R. Cognitive sciences and survey methods. In: Jabine TB, Straf ML, Tanur JM, Tourangeau R (eds), Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines. Washington, DC: National Academy Press, 1984; 73–101.Google Scholar
  9. 9.
    Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and the testing of survey questionnaires. Appl Cognit Psychol 1991; 5: 251–267.Google Scholar
  10. 10.
    Esposito JL, Jobe JB. A general model of the survey interaction process. Bureau of the Census Seventh Annual Research Conference Proceedings 1991; 537–560.Google Scholar
  11. 11.
    Forsyth BH, Lessler JT. Cognitive laboratory methods: a taxonomy. In: Biemer PP, Groves RM, Lyberg LE, Mathiowetz NA, Sudman S (eds), Measurement Errors in Surveys. New York: Wiley, 1991; 167–183.Google Scholar
  12. 12.
    Lessler JT, Forsyth BH. A coding system for appraising questionnaires. In: Schwarz N, Sudman S (eds), Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research. San Francisco: Jossey-Bass, 1996; 259–291.Google Scholar
  13. 13.
    Lee L, Brittingham A, Tourangeau R, et al. Are reporting errors due to encoding limitations or retrieval failure? Surveys of child vaccination as a case study. Appl Cognit Psychol 1999; 13: 43–63.Google Scholar
  14. 14.
    Smith AF. Cognitive processes in long-term dietary recall. Vital Health Stat 6. 1991; 4: 1–34.Google Scholar
  15. 15.
    Bercini DH. Pretesting questionnaires in the laboratory: an alternative approach. J Expo Anal Environ Epidemiol 1992; 2: 241–248.Google Scholar
  16. 16.
    Pratt WF, Tourangeau R, Jobe JB, et al. Asking sensitive questions in a health survey. Vital Health Stat 6 (in press).Google Scholar
  17. 17.
    Sudman S, Warnecke R, Johnson T, et al. Cognitive aspects of reporting cancer prevention examinations and tests. Vital Health Stat 6. 1994; 7: 1–171.Google Scholar
  18. 18.
    Willis GB. The use of the psychological laboratory to study sensitive survey topics. In: Harrison L, Hughes A (eds), The Validity of Self-reported Drug Use: Improving the Accuracy of Survey Estimates. Rockville, MD: National Institute on Drug Abuse, 1997; 416–438.Google Scholar
  19. 19.
    Jobe JB, Mingay DJ. Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Rep 1990; 105: 518–524.Google Scholar
  20. 20.
    Keller DM, Kovar MG, Jobe JB, Branch LG. Problems eliciting elders' reports of functional status. J Aging Health 1993; 5: 306–318.Google Scholar
  21. 21.
    Schechter S, Herrmann D. The proper use of self-report questions in effective measurement of health outcomes. Eval Health Prof 1997; 20: 28–46.Google Scholar
  22. 22.
    Subar AF, Thompson FE, Smith AF, et al. Improving food frequency questionnaires: A qualitative approach using cognitive interviews. J Am Diet Assoc 1995; 95: 781–788.Google Scholar
  23. 23.
    Smith AF, Jobe JB, Mingay DJ. Question-induced cognitive biases in reports of dietary intake by college men and women. Health Psychol 1991; 10: 244–251.Google Scholar
  24. 24.
    Smith AF, Jobe JB, Mingay DJ. Retrieval from memory of dietary information. Appl Cognit Psychol 1991; 5: 269–296.Google Scholar
  25. 25.
    Means B, Swan GE, Jobe JB, Esposito JL. An alternative approach to obtaining personal history data. In: Biemer PP, Groves RM, Lyberg LE, Mathiowetz NA, Sudman S (eds), Measurement Errors in Surveys. New York: Wiley, 1991; 167–183.Google Scholar
  26. 26.
    Thompson FE, Subar AF, Brown CC, et al. Cognitive research enhances accuracy of food frequency questionnaire reports: Results of an experimental validation study. J Am Diet Assoc 2002; 102: 212–218, 223-225.Google Scholar
  27. 27.
    Jobe JB, White AA, Kelley CL, et al. Recall strategies and memory for health care visits. Milbank Q 1991; 68: 171–189.Google Scholar
  28. 28.
    Brewer WF. Autobiographical memory and survey research. In: Schwarz N, Sudman S (eds), Autobiographical Memory and the Validity of Retrospective Reports. New York: Springer-Verlag, 1994; 11–20.Google Scholar
  29. 29.
    Wagenaar WA. My memory: A study of autobiographical memory over six years. Cognit Psychol 1986; 18: 225–252.Google Scholar
  30. 30.
    Drury CG, Paramore B, Van Gott HP, et al. Task analysis. In: Salvendy G (ed), Handbook of Human Factors. New York: Wiley, 1987; 370–401.Google Scholar
  31. 31.
    Krueger RA. Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: Sage, 1994.Google Scholar
  32. 32.
    Jobe JB, Mingay DJ. Cognitive research improves questionnaires. Am J Public Health 1989; 79: 1053–1055.Google Scholar
  33. 33.
    Means B, Loftus EF. When personal history repeats itself: Decomposing memories for recurring events. Appl Cognit Psychol 1991; 5: 297–318.Google Scholar
  34. 34.
    Tourangeau R, Rasinski KA. Cognitive processes underlying context effects in attitude measurement. Psychol Bull 1989; 103: 299–314.Google Scholar
  35. 35.
    Jenkins CR, Dillman DA. Towards a theory of self-administered questionnaire design. In: Lyberg L, Biemer P, Collins M, de Leeuw E, Dippo C, Schwarz N, Trewin D (eds), Survey Measurement and Process Quality. New York: Wiley, 1997; 165–196.Google Scholar
  36. 36.
    Mullen PA, Lohr KN, Bresnahan BW, McNulty P. Applying cognitive design principles to formatting HRQOL instruments. Qual Life Res 2000; 9: 13–27.Google Scholar

Copyright information

© Kluwer Academic Publishers 2003

Authors and Affiliations

  • Jared B. Jobe
    • 1
  1. 1.National Heart, Lung, and Blood InstituteBethesdaUSA

Personalised recommendations