Skip to main content
SpringerLink
Log in

Protocol Analysis as a Tool for Behavior Analysis

  • Published:
The Analysis of Verbal Behavior Aims and scope Submit manuscript

Abstract

The study of thinking is made difficult by the fact that many of the relevant stimuli and responses are not apparent. Although the use of verbal reports has a long history in psychology, it is only recently that Ericsson and Simon’s (1993) book on verbal reports explicated the conditions under which such reports may be reliable and valid. We review some studies in behavior analysis and cognitive psychology that have used talk-aloud reporting. We review particular methods for collecting reliable and valid verbal reports using the “talk-aloud” method as well as discuss alternatives to the talk-aloud procedure that are effective under different task conditions, such as the use of reports after completion of very rapid task performances. We specifically caution against the practice of asking subjects to reflect on the causes of their own behavior and the less frequently discussed problems associated with providing inappropriate social stimulation to participants during experimental sessions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ahlum-Heath, M. E., & DiVesta, F. J. (1986). The effects of conscious controlled verbalization of a cognitive strategy on transfer in problem solving. Memory and Cognition, 14, 281–285.

    Article  PubMed  Google Scholar 

  • Austin, J. (1996). Solving performance problems: Organizational troubleshooting in expert management consultants and experienced managers. Unpublished doctoral dissertation, Florida State University, Tallahassee, FL.

    Google Scholar 

  • Boreham, N. C. (1986). A model of efficiency in diagnostic problem solving: Implications for the education of diagnosticians. Instructional Science, 15, 191–211.

    Article  Google Scholar 

  • Bower, A. C., & King, W. L. (1967). The effect of number of irrelevant stimulus dimensions, verbalization, and sex on learning bi-directional classification rules. Psychonomic Science, 8, 453–454.

    Article  Google Scholar 

  • Brehmer, B. (1974). Hypotheses about relations between scaled variables in the learning of probabilistic inference tasks. Organizational Behavior and Human Performance, 11, 1–27.

    Article  Google Scholar 

  • Bristow, D., & Fristoe, M. (1984). Learning of blissymbols and manual signs. Journal of Speech and Hearing Disorders, 49, 145–151.

    Article  PubMed  Google Scholar 

  • Catania, A. C., Shimoff, E., & Matthews, B. A. (1989). An experimental analysis of rule-governed behavior. In S. C. Hayes (Ed.), Rule-governed behavior: Cognition, contingencies, and control (pp. 119–150). New York: Plenum.

    Chapter  Google Scholar 

  • Ceci, S. J., & Bruck, M. (1993). Suggestibility of the child witness: A historical review and synthesis. Psychological Bulletin, 113, 403–439.

    Article  PubMed  Google Scholar 

  • Chase, W. G., & Ericsson, K. A. (1981). Skilled memory. In J. R. Anderson (Ed.), Cognitive skills and their acquisition (pp. 141–189). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Chase, W. G., & Ericsson, K. A. (1982). Skill and working memory. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 16, pp. 1–58). New York: Academic Press.

    Article  Google Scholar 

  • Critchfield, T. S., & Perone, M. (1990). Verbal self-reports of delayed matching to sample by humans. Journal of the Experimental Analysis of Behavior, 53, 321–344.

    Article  PubMed  PubMed Central  Google Scholar 

  • Crutcher, R. J., Ericsson, K. A., & Wichura, C. A. (1994). Improving the encoding of verbal reports by using MPAS: A computer-aided encoding system. Behavior Research Methods, Instruments, and Computers, 26, 167–171.

    Article  Google Scholar 

  • de Groot, A. D. (1965). Thought and choice in chess. The Hague: Mouton.

    Google Scholar 

  • Delaney, P. F. (1997, May). Active behaviors in “storage” of information. In J. Austin (Chair), Human memory and remembering behavior. Symposium conducted at the 23rd annual convention of the Association for Behavior Analysis, Chicago.

    Google Scholar 

  • Delaney, P. F., & Austin, J. (1998). Memory as behavior: The importance of acquisition and remembering strategies. The Analysis of Verbal Behavior, 15, 75–91.

    PubMed  PubMed Central  Google Scholar 

  • Devany, J. M., Hayes, S. C., & Nelson, R. O. (1986). Equivalence class formation in language-able and language-disabled children. Journal of the Experimental Analysis of Behavior, 46, 243–257.

    Article  PubMed  PubMed Central  Google Scholar 

  • Duncker, K. (1926). A qualitative (experimental and theoretical) study of productive thinking (solving of comprehensible problems). Pedagogical Seminary, 33, 642–708.

    Article  Google Scholar 

  • Ericsson, K. A., & Delaney, P. F. (in press). Long-term working memory as an alternative to capacity models of working memory in everyday skilled performance. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control. New York: Cambridge University Press.

  • Ericsson, K. A., & Poison, P. G. (1988). Memory for restaurant orders. In M. T. H. Chi, R. Glaser, & M. Farr (Eds.), The nature of expertise (pp. 23–70). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1987). Verbal reports on thinking. In C. Faerch & G. Kasper (Eds.), Introspection in second language research (pp. 24–53). Philadelphia: Multilingual Matters, Ltd.

    Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (rev. ed.). Cambridge, MA: MIT Press.

    Google Scholar 

  • Gagne, R. H., & Smith, E. C. (1962). A study of the effects of verbalization on problem solving. Journal of Experimental Psychology, 63, 12–18.

    Article  PubMed  Google Scholar 

  • Hayes, L. J. (1994). Thinking. In S. C. Hayes, L. J. Hayes, M. Sato, & K. Ono (Eds.), Behavior analysis of language and cognition (pp. 149–164). Reno, NV: Context Press.

    Google Scholar 

  • Hayes, S. C. (1986). The case of the silent dog - verbal reports and the analysis of rules: A review of Ericsson and Simon’s Protocol Analysis: Verbal Reports as Data. Journal of the Experimental Analysis of Behavior, 45, 351–363.

    Article  PubMed Central  Google Scholar 

  • Hayes, S. C., White, D., & Bissett, R. T. (1998). Protocol analysis and the “silent dog” method of analyzing the impact of self-generated rules. The Analysis of Verbal Behavior, 15, 57–63.

    PubMed  PubMed Central  Google Scholar 

  • Hendrix, G. (1947). A new clue to transfer of training. Elementary School Journal, 48, 197–208.

    Article  Google Scholar 

  • Hodges, P., & Schwethelm, B. (1984). A comparison of the effectiveness of graphic symbol and manual sign training with profoundly retarded children. Applied Psycholinguistics, 5, 223–253.

    Article  Google Scholar 

  • Karpf, D. (1972). Thinking aloud in human discrimination learning (Doctoral dissertation, State University of New York at Stony Brook, 1972). Dissertation Abstracts International, 33, 6111-B. (University Microfilms No. 73-13625)

  • Karpf, D., & Levine, M. (1971). Blank-trial probes and introtacts in human discrimination learning. Journal of Experimental Psychology, 90, 51–55.

    Article  Google Scholar 

  • Lane, S. D., & Critchfield, T. S. (1996). Verbal reports of emergent relations in a stimulus equivalence procedure. Journal of the Experimental Analysis of Behavior, 65, 355–374.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lindsley, O. R. (1996). Is fluency free-operant response-response chaining? The Behavior Analyst, 19, 211–224.

    Article  PubMed  PubMed Central  Google Scholar 

  • Loftus, E. F. (1996). Memory distortion and false memory creation. Bulletin of the American Academy of Psychiatry and the Law, 24, 281–295.

    PubMed  Google Scholar 

  • Loftus, E. F., & Hoffman, H.G. (1989). Misinformation and memory: The creation of new memories. Journal of Experimental Psychology: General, 118, 100–104.

    Article  Google Scholar 

  • Loftus, E. F., & Palmer, J. C. (1974). Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of Verbal Learning and Verbal Behavior, 13, 585–589.

    Article  Google Scholar 

  • Loftus, E. F., & Pickrell, J. E. (1995). The formation of false memories. Psychiatric Annals, 25, 720–725.

    Article  Google Scholar 

  • Lowenkron, B. (1991). Joint control and the generalization of selection-based verbal behavior. The Analysis of Verbal Behavior, 9, 121–126.

    PubMed  PubMed Central  Google Scholar 

  • Manning, C. G., & Loftus, E. F. (1996). Eyewitness testimony and memory distortion. Japanese Psychological Research, 38, 5–13.

    Article  Google Scholar 

  • Michael, J. (1985). Two kinds of verbal behavior plus a possible third. The Analysis of Verbal Behavior, 3, 1–4.

    PubMed  PubMed Central  Google Scholar 

  • Michael, J. (1993). Concepts and principles of behavior analysis. Kalamazoo, MI: Society for the Advancement of Behavior Analysis.

    Google Scholar 

  • Nelson, R. O. (1977). Assessment and therapeutic functions of self-monitoring. In M. Hersen, R. M. Eisler, & P. Miller (Eds.), Progress in behavior modifcation (Vol. 5, pp. 263–308). New York: Academic Press.

    Article  Google Scholar 

  • Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259.

    Article  Google Scholar 

  • Perone, M. (1988). Laboratory lore and research practices in the experimental analysis of human behavior: Use and abuse of subjects’ verbal reports. The Behavior Analyst, 11, 71–75.

    PubMed  PubMed Central  Google Scholar 

  • Potter, B. (Chair). (1997, May). The use of protocol analyses in research. Panel discussion conducted at the 23rd annual convention of the Association for Behavior Analysis, Chicago.

    Google Scholar 

  • Potter, B., Huber, S., & Michael, J. (1997). The role of mediating verbal behavior in selection-based responding. The Analysis of Verbal Behavior, 14, 41–56.

    PubMed  PubMed Central  Google Scholar 

  • Reber, A. S., & Lewis, S. (1979). Implicit learning: An analysis of the form and structure of a body of tacit knowledge. Cognition, 5, 333–361.

    Article  Google Scholar 

  • Rommetveit, R. (1960). Stages in concept formation and levels of cognitive functioning. Scandinavian Journal of Psychology, 1, 115–124.

    Article  Google Scholar 

  • Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989). The validity of verbal protocols. Memory & Cognition 17, 759–769.

    Article  Google Scholar 

  • Schweiger, D. M. (1983). Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making? Academy of Management Journal, 26, 185–192.

    Article  Google Scholar 

  • Shimoff, E. (1984). Post-session questionnaires. Experimental Analysis of Human Behavior Bulletin, 2, 1.

    Google Scholar 

  • Sidman, M. (1971). Reading and auditory-visual equivalences. Journal of Speech and Hearing Research, 14, 5–13.

    Article  PubMed  Google Scholar 

  • Sidman, M., & Tailby, W. (1982). Conditional discrimination vs. matching to sample: An expansion of the testing paradigm. Journal of the Experimental Analysis of Behavior, 37, 5–22.

    Article  PubMed  PubMed Central  Google Scholar 

  • Simon, H. A. (1979). Models of thought (Vol. 1). New Haven, CT: Yale University Press.

  • Skinner, B. F. (1957). Verbal behavior. New York: Appleton-Century-Crofts.

    Book  Google Scholar 

  • Skinner, B. F. (1974). About behaviorism. New York: Knopf.

    Google Scholar 

  • Sorabji, R. (1972). Aristotle on memory. Providence, RI: Brown University Press.

    Google Scholar 

  • Storms, M. D. (1973). Videotape and the attribution process: Reversing actors’ and observers’ points of view. Journal of Personality and Social Psychology, 27, 165–175.

    Article  PubMed  Google Scholar 

  • Sundberg, C. T., & Sundberg, M. L. (1990). Comparing topography-based verbal behavior with stimulus selection-based verbal behavior. The Analysis of Verbal Behavior, 8, 31–41.

    PubMed  PubMed Central  Google Scholar 

  • Titchener, E. B. (1912). The schema of introspection. American Journal of Psychology, 23, 485–508.

    Article  Google Scholar 

  • Watson, J. B. (1920). Is thinking merely the action of language mechanisms? British Journal of Psychology, 11, 87–104.

    Google Scholar 

  • Wilder, L., & Harvey, D. J. (1971). Overt and covert verbalization in problem solving. Speech Monographs, 38, 171–176.

    Article  Google Scholar 

  • Wulfert, E., Dougher, M. J., & Greenway, D. E. (1991). Protocol analysis of the correspondence of verbal behavior and equivalence class formation. Journal of the Experimental Analysis of Behavior, 56, 489–504.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Western Michigan University, Kalamazoo, Michigan, 49008, USA

    John Austin

  2. Florida State University, USA

    Peter F. Delaney

Authors
  1. John Austin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter F. Delaney
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John Austin.

Additional information

We thank K. Anders Ericsson for his helpful comments and criticism of this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Austin, J., Delaney, P.F. Protocol Analysis as a Tool for Behavior Analysis. Analysis Verbal Behav 15, 41–56 (1998). https://doi.org/10.1007/BF03392922

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03392922

Search

Navigation