Advertisement

The Analysis of Verbal Behavior

, Volume 15, Issue 1, pp 41–56 | Cite as

Protocol Analysis as a Tool for Behavior Analysis

Article

Abstract

The study of thinking is made difficult by the fact that many of the relevant stimuli and responses are not apparent. Although the use of verbal reports has a long history in psychology, it is only recently that Ericsson and Simon’s (1993) book on verbal reports explicated the conditions under which such reports may be reliable and valid. We review some studies in behavior analysis and cognitive psychology that have used talk-aloud reporting. We review particular methods for collecting reliable and valid verbal reports using the “talk-aloud” method as well as discuss alternatives to the talk-aloud procedure that are effective under different task conditions, such as the use of reports after completion of very rapid task performances. We specifically caution against the practice of asking subjects to reflect on the causes of their own behavior and the less frequently discussed problems associated with providing inappropriate social stimulation to participants during experimental sessions.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ahlum-Heath, M. E., & DiVesta, F. J. (1986). The effects of conscious controlled verbalization of a cognitive strategy on transfer in problem solving. Memory and Cognition, 14, 281–285.CrossRefPubMedGoogle Scholar
  2. Austin, J. (1996). Solving performance problems: Organizational troubleshooting in expert management consultants and experienced managers. Unpublished doctoral dissertation, Florida State University, Tallahassee, FL.Google Scholar
  3. Boreham, N. C. (1986). A model of efficiency in diagnostic problem solving: Implications for the education of diagnosticians. Instructional Science, 15, 191–211.CrossRefGoogle Scholar
  4. Bower, A. C., & King, W. L. (1967). The effect of number of irrelevant stimulus dimensions, verbalization, and sex on learning bi-directional classification rules. Psychonomic Science, 8, 453–454.CrossRefGoogle Scholar
  5. Brehmer, B. (1974). Hypotheses about relations between scaled variables in the learning of probabilistic inference tasks. Organizational Behavior and Human Performance, 11, 1–27.CrossRefGoogle Scholar
  6. Bristow, D., & Fristoe, M. (1984). Learning of blissymbols and manual signs. Journal of Speech and Hearing Disorders, 49, 145–151.CrossRefPubMedGoogle Scholar
  7. Catania, A. C., Shimoff, E., & Matthews, B. A. (1989). An experimental analysis of rule-governed behavior. In S. C. Hayes (Ed.), Rule-governed behavior: Cognition, contingencies, and control (pp. 119–150). New York: Plenum.CrossRefGoogle Scholar
  8. Ceci, S. J., & Bruck, M. (1993). Suggestibility of the child witness: A historical review and synthesis. Psychological Bulletin, 113, 403–439.CrossRefPubMedGoogle Scholar
  9. Chase, W. G., & Ericsson, K. A. (1981). Skilled memory. In J. R. Anderson (Ed.), Cognitive skills and their acquisition (pp. 141–189). Hillsdale, NJ: Erlbaum.Google Scholar
  10. Chase, W. G., & Ericsson, K. A. (1982). Skill and working memory. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 16, pp. 1–58). New York: Academic Press.CrossRefGoogle Scholar
  11. Critchfield, T. S., & Perone, M. (1990). Verbal self-reports of delayed matching to sample by humans. Journal of the Experimental Analysis of Behavior, 53, 321–344.CrossRefPubMedPubMedCentralGoogle Scholar
  12. Crutcher, R. J., Ericsson, K. A., & Wichura, C. A. (1994). Improving the encoding of verbal reports by using MPAS: A computer-aided encoding system. Behavior Research Methods, Instruments, and Computers, 26, 167–171.CrossRefGoogle Scholar
  13. de Groot, A. D. (1965). Thought and choice in chess. The Hague: Mouton.Google Scholar
  14. Delaney, P. F. (1997, May). Active behaviors in “storage” of information. In J. Austin (Chair), Human memory and remembering behavior. Symposium conducted at the 23rd annual convention of the Association for Behavior Analysis, Chicago.Google Scholar
  15. Delaney, P. F., & Austin, J. (1998). Memory as behavior: The importance of acquisition and remembering strategies. The Analysis of Verbal Behavior, 15, 75–91.PubMedPubMedCentralGoogle Scholar
  16. Devany, J. M., Hayes, S. C., & Nelson, R. O. (1986). Equivalence class formation in language-able and language-disabled children. Journal of the Experimental Analysis of Behavior, 46, 243–257.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Duncker, K. (1926). A qualitative (experimental and theoretical) study of productive thinking (solving of comprehensible problems). Pedagogical Seminary, 33, 642–708.CrossRefGoogle Scholar
  18. Ericsson, K. A., & Delaney, P. F. (in press). Long-term working memory as an alternative to capacity models of working memory in everyday skilled performance. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control. New York: Cambridge University Press.Google Scholar
  19. Ericsson, K. A., & Poison, P. G. (1988). Memory for restaurant orders. In M. T. H. Chi, R. Glaser, & M. Farr (Eds.), The nature of expertise (pp. 23–70). Hillsdale, NJ: Erlbaum.Google Scholar
  20. Ericsson, K. A., & Simon, H. A. (1987). Verbal reports on thinking. In C. Faerch & G. Kasper (Eds.), Introspection in second language research (pp. 24–53). Philadelphia: Multilingual Matters, Ltd.Google Scholar
  21. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (rev. ed.). Cambridge, MA: MIT Press.Google Scholar
  22. Gagne, R. H., & Smith, E. C. (1962). A study of the effects of verbalization on problem solving. Journal of Experimental Psychology, 63, 12–18.CrossRefPubMedGoogle Scholar
  23. Hayes, L. J. (1994). Thinking. In S. C. Hayes, L. J. Hayes, M. Sato, & K. Ono (Eds.), Behavior analysis of language and cognition (pp. 149–164). Reno, NV: Context Press.Google Scholar
  24. Hayes, S. C. (1986). The case of the silent dog - verbal reports and the analysis of rules: A review of Ericsson and Simon’s Protocol Analysis: Verbal Reports as Data. Journal of the Experimental Analysis of Behavior, 45, 351–363.CrossRefPubMedCentralGoogle Scholar
  25. Hayes, S. C., White, D., & Bissett, R. T. (1998). Protocol analysis and the “silent dog” method of analyzing the impact of self-generated rules. The Analysis of Verbal Behavior, 15, 57–63.PubMedPubMedCentralGoogle Scholar
  26. Hendrix, G. (1947). A new clue to transfer of training. Elementary School Journal, 48, 197–208.CrossRefGoogle Scholar
  27. Hodges, P., & Schwethelm, B. (1984). A comparison of the effectiveness of graphic symbol and manual sign training with profoundly retarded children. Applied Psycholinguistics, 5, 223–253.CrossRefGoogle Scholar
  28. Karpf, D. (1972). Thinking aloud in human discrimination learning (Doctoral dissertation, State University of New York at Stony Brook, 1972). Dissertation Abstracts International, 33, 6111-B. (University Microfilms No. 73-13625)Google Scholar
  29. Karpf, D., & Levine, M. (1971). Blank-trial probes and introtacts in human discrimination learning. Journal of Experimental Psychology, 90, 51–55.CrossRefGoogle Scholar
  30. Lane, S. D., & Critchfield, T. S. (1996). Verbal reports of emergent relations in a stimulus equivalence procedure. Journal of the Experimental Analysis of Behavior, 65, 355–374.CrossRefPubMedPubMedCentralGoogle Scholar
  31. Lindsley, O. R. (1996). Is fluency free-operant response-response chaining? The Behavior Analyst, 19, 211–224.CrossRefPubMedPubMedCentralGoogle Scholar
  32. Loftus, E. F. (1996). Memory distortion and false memory creation. Bulletin of the American Academy of Psychiatry and the Law, 24, 281–295.PubMedGoogle Scholar
  33. Loftus, E. F., & Hoffman, H.G. (1989). Misinformation and memory: The creation of new memories. Journal of Experimental Psychology: General, 118, 100–104.CrossRefGoogle Scholar
  34. Loftus, E. F., & Palmer, J. C. (1974). Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of Verbal Learning and Verbal Behavior, 13, 585–589.CrossRefGoogle Scholar
  35. Loftus, E. F., & Pickrell, J. E. (1995). The formation of false memories. Psychiatric Annals, 25, 720–725.CrossRefGoogle Scholar
  36. Lowenkron, B. (1991). Joint control and the generalization of selection-based verbal behavior. The Analysis of Verbal Behavior, 9, 121–126.PubMedPubMedCentralGoogle Scholar
  37. Manning, C. G., & Loftus, E. F. (1996). Eyewitness testimony and memory distortion. Japanese Psychological Research, 38, 5–13.CrossRefGoogle Scholar
  38. Michael, J. (1985). Two kinds of verbal behavior plus a possible third. The Analysis of Verbal Behavior, 3, 1–4.PubMedPubMedCentralGoogle Scholar
  39. Michael, J. (1993). Concepts and principles of behavior analysis. Kalamazoo, MI: Society for the Advancement of Behavior Analysis.Google Scholar
  40. Nelson, R. O. (1977). Assessment and therapeutic functions of self-monitoring. In M. Hersen, R. M. Eisler, & P. Miller (Eds.), Progress in behavior modifcation (Vol. 5, pp. 263–308). New York: Academic Press.CrossRefGoogle Scholar
  41. Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.Google Scholar
  42. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259.CrossRefGoogle Scholar
  43. Perone, M. (1988). Laboratory lore and research practices in the experimental analysis of human behavior: Use and abuse of subjects’ verbal reports. The Behavior Analyst, 11, 71–75.PubMedPubMedCentralGoogle Scholar
  44. Potter, B. (Chair). (1997, May). The use of protocol analyses in research. Panel discussion conducted at the 23rd annual convention of the Association for Behavior Analysis, Chicago.Google Scholar
  45. Potter, B., Huber, S., & Michael, J. (1997). The role of mediating verbal behavior in selection-based responding. The Analysis of Verbal Behavior, 14, 41–56.PubMedPubMedCentralGoogle Scholar
  46. Reber, A. S., & Lewis, S. (1979). Implicit learning: An analysis of the form and structure of a body of tacit knowledge. Cognition, 5, 333–361.CrossRefGoogle Scholar
  47. Rommetveit, R. (1960). Stages in concept formation and levels of cognitive functioning. Scandinavian Journal of Psychology, 1, 115–124.CrossRefGoogle Scholar
  48. Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989). The validity of verbal protocols. Memory & Cognition 17, 759–769.CrossRefGoogle Scholar
  49. Schweiger, D. M. (1983). Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making? Academy of Management Journal, 26, 185–192.CrossRefGoogle Scholar
  50. Shimoff, E. (1984). Post-session questionnaires. Experimental Analysis of Human Behavior Bulletin, 2, 1.Google Scholar
  51. Sidman, M. (1971). Reading and auditory-visual equivalences. Journal of Speech and Hearing Research, 14, 5–13.CrossRefPubMedGoogle Scholar
  52. Sidman, M., & Tailby, W. (1982). Conditional discrimination vs. matching to sample: An expansion of the testing paradigm. Journal of the Experimental Analysis of Behavior, 37, 5–22.CrossRefPubMedPubMedCentralGoogle Scholar
  53. Simon, H. A. (1979). Models of thought (Vol. 1). New Haven, CT: Yale University Press.Google Scholar
  54. Skinner, B. F. (1957). Verbal behavior. New York: Appleton-Century-Crofts.CrossRefGoogle Scholar
  55. Skinner, B. F. (1974). About behaviorism. New York: Knopf.Google Scholar
  56. Sorabji, R. (1972). Aristotle on memory. Providence, RI: Brown University Press.Google Scholar
  57. Storms, M. D. (1973). Videotape and the attribution process: Reversing actors’ and observers’ points of view. Journal of Personality and Social Psychology, 27, 165–175.CrossRefPubMedGoogle Scholar
  58. Sundberg, C. T., & Sundberg, M. L. (1990). Comparing topography-based verbal behavior with stimulus selection-based verbal behavior. The Analysis of Verbal Behavior, 8, 31–41.PubMedPubMedCentralGoogle Scholar
  59. Titchener, E. B. (1912). The schema of introspection. American Journal of Psychology, 23, 485–508.CrossRefGoogle Scholar
  60. Watson, J. B. (1920). Is thinking merely the action of language mechanisms? British Journal of Psychology, 11, 87–104.Google Scholar
  61. Wilder, L., & Harvey, D. J. (1971). Overt and covert verbalization in problem solving. Speech Monographs, 38, 171–176.CrossRefGoogle Scholar
  62. Wulfert, E., Dougher, M. J., & Greenway, D. E. (1991). Protocol analysis of the correspondence of verbal behavior and equivalence class formation. Journal of the Experimental Analysis of Behavior, 56, 489–504.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Association of Behavior Analysis International 1998

Authors and Affiliations

  1. 1.Department of PsychologyWestern Michigan UniversityKalamazooUSA
  2. 2.Florida State UniversityUSA

Personalised recommendations