Abstract
In this paper, we describe two experiments in which we assessed the validity of phased narrowing, a new process tracing technique designed to help researchers better understand multiattribute evaluation processes. Specifically, in Experiment 1 we examined the distribution of choices across successive decision stages and the attitudes and perceptions of the decision maker. In Experiment 2, we examined a variety of process data generated via a computerized information monitoring program called Mouse-Trace. Comparisons, in all cases, are made between experimental conditions that do and do not require decision makers to narrow their choices across successive stages. Taken together, the data indicate that there is little evidence to doubt the validity of a less restrictive version of phased narrowing which allows subjects to choose their own number of options to include at each stage. These results are encouraging for researchers who plan to use the technique to study decision making in its natural context.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Anderson, N. H. (1982).Methods of information integration theory. New York: Academic Press.
Anderson, N. H., &Zalinski, J. (1988). Functional measurement approach to self-estimation in multiattribute evaluation.Journal of Behavioral Decision Making,1, 191–221.
Beach, L. R. (1993). Broadening the definition of decision making: The role of prechoice screening of options.Psychological Science,4, 215–220.
Bockenholt, U., &Hynan, L. S. (1994). Caveats on a process tracing measure and a remedy.Journal of Behavioral Decision Making,1, 103–117.
Carroll, J. S., &Payne, J. M. (1977). Judgements about crime and the criminal: A model and a method for investigating parole decisions. In B. D. Sales (Ed.),Perspectives in law and psychology: The criminal justice system (Vol. 1, pp. 41–55). New York: Plenum.
Ericsson, K. A., &Simon, H. A. (1993).Protocol analysis: Verbal reports as data (rev. ed.). Cambridge, MA: MIT Press.
Fidler, E. J. (1983). The reliability and validity of concurrent, retrospective, and interpretive verbal reports: An experimental study. In P. Humphreys, O. Svenson, & A. Vari (Eds.),Analysing and aiding decision processes (pp. 429–440). Amsterdam: Elsevier.
Jasper, J. D. (2002).How people deal with missing information: Insights from process tracing. Manuscript in preparation.
Jasper, J. D., & Shapiro, J. (2001).MouseTrace: A better mousetrap for catching decision processes. Manuscript submitted for publication.
Johnson, E. J., Payne, J. W., Schkade, D. A., &Bettman, J. R. (1991).Monitoring information processing and decisions: The Mouselab system. Unpublished manuscript. Durham, NC: Duke University, Fuqua School of Business, Center for Decision Studies.
Judd, C. M., &McClelland, G. H. (1989).Data analysis: A model-comparison approach. San Diego, CA: Harcourt Brace Jovanovich.
Levin, I. P., Huneke, M. E., &Jasper, J. D. (2000). Information processing at successive stages of decision making: Need-for-cognition and inclusion-exclusion effects.Organizational Behavior & Human Decision Processes,82, 171–193.
Levin, I. P., &Jasper, J. D. (1995). Phased narrowing: A new process tracing method for decision making.Organizational Behavior & Human Decision Processes,64, 1–8.
Levin, I. P., &Jasper, J. D. (1996). An experimental analysis of nationalistic tendencies in consumer decision processes: The case of the multi-national product.Journal of Experimental Psychology: Applied,2, 17–30.
Levin, I. P., Jasper, J. D., &Forbes, W. S. (1998). Choosing versus rejecting options at different stages of decision making.Journal of Be havioral Decision Making,11, 193–210.
Levin, I. P., Jasper, J. D., &Gaeth, G. J. (1996). Measuring the effects of framing country-of-origin information: A process tracing approach.Advances in Consumer Research,23, 385–389.
Levin, I. P., Jasper, J. D., Mittelstaedt, J. D., &Gaeth, G. J. (1993). Attitudes toward “buy America first” and preferences for American and Japanese cars: A different role for country-of-origin information.Advances in Consumer Research,20, 625–629.
Levin, I. P., Johnson, R. D., & Jasper, J. D. (December, 1993). The role of nationalism in the consumer choice process: Comparison between the U. S. and Canada. In G. S. Albaum et al. (Eds.),Proceedings of the Fourth Symposium on Cross-Cultural Consumer and Business Studies.
Nedungadi, P. (1990). Recall and consumer consideration sets: Influencing choices without altering brand evaluations.Journal of Consumer Research,17, 245–253.
Olshavsky, R. W. (1979). Task complexity and contingent processing in decision making: A replication and extension.Organizational Behavior & Human Performance,24, 300–316.
Payne, J. W. (1976). Task complexity and contingent processing in decision making: An information search and protocol analysis.Organizational Behavior & Human Performance,16, 366–387.
Payne, J. W., Bettman, J. R., &Johnson, E. J. (1988). Adaptive strategy selection in decision making.Journal of Experimental Psychology: Learning, Memory, & Cognition,14, 534–552.
Payne, J. W., Bettman, J. R., &Johnson, E. J. (1993).The adaptive decision maker. Cambridge: Cambridge University Press.
Roberts, J. [H.] (1989). A grounded model of consideration set size and composition.Advances in Consumer Research,16, 749–757.
Roberts, J. H., &Lattin, J. M. (1991). Development and testing of a model of consideration set composition.Journal of Marketing Research,28, 429–440.
Shimp, T. A., &Sharma, S. (1987). Consumer ethnocentrism: Construction and validation of the CETSCALE.Journal of Marketing Research,24, 280–289.
Shocker, A. D., Ben-Akiva, M., Boccara, B., &Nedungadi, P. (1991). Consideration set influences on consumer decision-making and choice: Issues, models, and suggestions.Marketing Letters,2, 181–197.
Slovic, P., &Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches to the study of information processing in judgment.Organizational Behavior & Human Performance,6, 649–744.
Smead, R. J., Wilcox, J. B., &Wilkes, R. E. (1981). How valid are product descriptions and protocols in choice experiments?Journal of Consumer Research,8, 37–42.
Zhu, S., &Anderson, N. H. (1991). Self-estimation of weight parameter in multi-attribute analysis.Organizational Behavior & Human Decision Processes,48, 36–54.
Author information
Authors and Affiliations
Corresponding author
Additional information
This project was supported in part by grants from the Department of Psychology, University of Iowa (Experiment 1), and from the University of Toronto (Experiment 2).
Rights and permissions
About this article
Cite this article
Jasper, J.D., Levin, I.P. Validating a new process tracing method for decision making. Behavior Research Methods, Instruments, & Computers 33, 496–512 (2001). https://doi.org/10.3758/BF03195408
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195408