Abstract
Interpersonal variability in understanding linguistic probabilities can adversely affect decision making. Using the fact that everyone judges canonical probability events similarly in a manner consistent with axiom systems that yield a probability measure, we developed and tested a method for comparing the meanings of probability phrases across individuals. An experiment demonstrated that despite extreme heterogeneity in participants’ linguistic probability lexicons, interpersonal similarity in phrase meaning is well predicted by phrase rank order within the lexicons. Thus, equally ranked phrases have similar meanings, and individual differences in linguistic probabilities may simply be explained by the phrases people use at each rank.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bartoshuk, L. A., Duffy, V. B., Fast, K., Green, B. G., Prutkin, J., &Snyder, D. J. (2002). Labeled scales (e.g., category, Likert, VAS) and invalid across-group comparisons: What we have learned from genetic variation in taste.Food Quality & Preference,14, 125–138.
Beyth-Marom, R. (1982). How probable is probable? Numerical translation of verbal probability expressions.Journal of Forecasting,1, 257–269.
Borg, G. (1982). A category scale with ratio properties for intermodal and interindividual comparisons. In H. Geissler, P. Petzold, H. Buffart, & Y. Zabrodin (Eds.),Psychophysical judgment and the process of perception (pp. 25–34). Amsterdam: North-Holland.
Bradburn, N. W., &Miles, C. (1979). Vague quantifiers.Public Opinion Quarterly,43, 92–101.
Brun, W., &Teigen, K. (1988). Verbal probabilities: Ambiguous, contextdependent, or both?Organizational Behavior & Human Decision Processes,41, 390–404.
Bryant, G. D., &Norman, G. R. (1980). Expressions of probability: Words and numbers.New England Journal of Medicine,302, 411.
Budescu, D. V., Karelitz, T., &Wallsten, T. S. (2003). Predicting the directionality of probability words from their membership functions.Journal of Behavioral Decision Making,16, 159–180.
Budescu, D. V., &Wallsten, T. S. (1985). Consistency in interpretation of probabilistic phrases.Organizational Behavior & Human Decision Processes,36, 391–405.
Budescu, D. V., &Wallsten, T. S. (1990). Dyadic decisions with numerical and verbal probabilities.Organizational Behavior & Human Decision Processes,46, 240–263.
Budescu, D. V., &Wallsten, T. S. (1995). Processing linguistic probabilities: General principles and empirical evidence. In J. Busemeyer, D. L. Medin, & R. Hastie (Eds.),Decision making from a cognitive perspective (pp. 275–318). New York: Academic Press.
Budescu, D. V., Weinberg, S., &Wallsten, T. S. (1988). Decisions based on numerically and verbally expressed uncertainties.Journal of Experimental Psychology: Human Perception & Performance,14, 281–294.
Clark, D. A. (1990). Verbal uncertainty expressions: A review of two decades of research.Current Psychology: Research & Reviews,9, 203–235.
de Finetti, B. (1964). La prévision: Ses lois logiques, ses sources subjectivesAnnales de l’Institut Henri Poincaré,7, 1–68. (Original work published 1937)
Erev, I., &Cohen, B. L. (1990). Verbal versus numerical probabilities: Efficiency, biases, and the preference paradox.Organizational Behavior & Human Decision Processes,44, 1–18.
Fillenbaum, S., Wallsten, T. S., Cohen, B. L., &Cox, J. A. (1991). Some effects of vocabulary and communication task on the understanding and use of vague probability expressions.American Journal of Psychology,104, 35–60.
Fishburn, P. (1970). Utility theory for decision making (Vol. 18). New York: Wiley.
González-Vallejo, C., Erev, I., &Wallsten, T. S. (1994). Do decision quality and preference order depend on whether probabilities are verbal or numerical?American Journal of Psychology,107, 157–172.
González-Vallejo, C., &Wallsten, T. S. (1992). Effects of probability mode on preference reversal.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 855–864.
Hacking, I. (1975).The emergence of probability. Cambridge: Cambridge University Press.
Hamm, R. M. (1991). Selection of verbal probabilities: A solution for some problems of verbal probability expression.Organizational Behavior & Human Decision Processes,48, 193–223.
Jaffe-Katz, A., Budescu, D. V., &Wallsten, T. S. (1989). Timed magnitude comparisons of numerical and nonnumerical expressions of uncertainty.Memory & Cognition,17, 249–264.
Kahneman, D., &Tversky, A. (1982). Variants of uncertainty.Cognition,11, 143–157.
Karelitz, T., &Budescu, D. V. (2004). You say probable and I say likely: Improving interpersonal communication with verbal probability phrases.Journal of Experimental Psychology: Applied,10, 25–41.
Karelitz, T., Budescu, D. V., & Wallsten, T. S. (2000, November). Validation of a new technique for eliciting membership functions of probability phrases. Poster presented at the meeting of the Society for Judgment and Decision Making, New Orleans.
Kong, A., Barnett, G. O., Mosteller, F., &Youtz, C. (1986). How medical professionals evaluate expressions of probability.New England Journal of Medicine,315, 740–744.
Krantz, D. H., Luce, R. D., Suppes, P., &Tversky, A. (1971). Foundations of measurement 1: Additive and polynomial representation. New York: Academic Press.
Laming, D. R. J. (1997).The measurement of sensation. London: Oxford University Press.
Lichtenstein, S., &Newman, J. R. (1967). Empirical scaling of common verbal phrases associated with numerical probabilities.Psychonomic Science,9, 563–564.
Luce, R. D. (1959).Individual choice behavior: A theoretical analysis. New York: Wiley.
Marshall, E. (1986). Feynman issues his own shuttle report, attacking NASA’s risk estimates.Science,232, 1596.
Mosteller, F., &Youtz, C. (1990). Quantifying probabilistic expressions.Statistical Science,5, 2–34.
Mullet, E., &Rivet, I. (1991). Comprehension of verbal probability expressions in children and adolescents.Language & Communication,11, 217–225.
Narens, L., &Luce, R. D. (1983). How we may have been misled into believing in the interpersonal comparability of utility.Theory & Decision,15, 247–260.
Newstead, S. E. (1988). Quantifiers as fuzzy concepts. In T. Zetenyi (Ed.),Fuzzy sets in psychology (pp. 51–72). Amsterdam: Elsevier, North-Holland.
Olson, M. J., &Budescu, D. V. (1997). Patterns of preference for numerical and verbal probabilities.Journal of Behavioral Decision Making,10, 117–131.
Rapoport, A., Wallsten, T. S., &Cox, J. A. (1987). Direct and indirect scaling of membership functions of probability phrases.Mathematical Modeling,9, 397–417.
Reagan, T. R., Mosteller, F., &Youtz, C. (1989). Quantitative meanings of verbal probability expressions.Journal of Applied Psychology,74, 433–442.
Renooij, S., &Witteman, C. (1999). Talking probabilities: Communicating probabilistic information with words and numbers.International Journal of Approximate Reasoning,22, 169–194.
Savage, L. J. (1972).The foundations of statistics (2nd rev. ed.). New York: Dover.
Schwarz, N. (1999). Frequency reports of physical symptoms and health behaviors: How the questionnaire determines the results. In D. C. Park, R. W. Morrell, & K. Shifre (Eds.),Processing of medical information in aging patients (pp. 93–108). Mahwah, NJ: Erlbaum.
Simpson, R. H. (1944). The specific meanings of certain terms indicating differing degrees of frequency.Quarterly Journal of Speech,30, 328–330.
Stewart, N., Chater, N., Stott, H. P., &Reimers, S. (2003). Prospect relativity: How choice options influence decision under risk.Journal of Experimental Psychology: General,132, 23–46.
Tanur, J. M. (1990).Comment.Statistical Science,5, 21–22.
Teghtsoonian, R., Teghtsoonian, M., &Karlsson, J. G. (1981). The limits of perceived magnitude: Comparison among individuals and among perceptual continua.Acta Psychologica,49, 83–94.
Teigen, K. H., &Brun, W. (1995). Yes, but it is uncertain: Direction and communicative intention of verbal probabilistic terms.Acta Psychologica,88, 233–258.
Tourangeau, R., Rips, L. J., &Rasinski, K. (2000).The psychology of survey responses. New York: Cambridge University Press.
Tversky, A. (1967). Additivity, utility and subjective probability.Journal of Mathematical Psychology,4, 175–201.
von Winterfeldt, D., &Edwards, W. (1986).Decision analysis and behavioral research. Cambridge: Cambridge University Press.
Wallsten, T. S. (1971). Subjectively expected utility theory and subjects’ probability estimates: Use of measurement-free techniques.Journal of Experimental Psychology,88, 31–40.
Wallsten, T. S. (1974). The psychological concept of subjective probability: A measurement theoretical view. In C. A. S. Stael von Holstein (Ed.),The concept of probability in psychological experiments (pp. 49–72). Dordrecht: Reidel.
Wallsten, T. S. (1990). Measuring vague uncertainties and understanding their use in decision making. In G. M. Von Furstenberg (Ed.),Acting under uncertainty: Multidisciplinary conceptions (pp. 377–398). London: Kluwer.
Wallsten, T. S., &Budescu, D. V. (1983). Encoding subjective probabilities: A psychological and psychometric review.Management Science,29, 151–173.
Wallsten, T. S., &Budescu, D. V. (1990). Comment on Mosteller and Youtz’ “Quantifying probabilistic expressions.”Statistical Science,5, 23–26.
Wallsten, T. S., Budescu, D. V., Rapoport, A., Zwick, R., &Forsyth, B. (1986). Measuring the vague meanings of probability terms.Journal of Experimental Psychology: General,115, 348–365.
Wallsten, T. S., Budescu, D. V., &Zwick, R. (1993). Comparing the calibration and coherence of numerical and verbal probability judgments.Management Science,39, 176–190.
Wallsten, T. S., Budescu, D. V., Zwick, R., &Kemp, S. M. (1993). Preferences and reasons for communicating probabilistic information in verbal or numerical terms.Bulletin of the Psychonomic Society,31, 135–138.
Wallsten, T. S., Fillenbaum, S., &Cox, A. (1986). Base-rate effects on the interpretations of probability and frequency expressions.Journal of Memory & Language,25, 571–587.
Weber, E. U., &Hilton, D. J. (1990). Contextual effects in the interpretations of probability words: Perceived base rate and severity of events.Journal of Experimental Psychology: Human Perception & Performance,16, 781–789.
Zadeh, L. A. (1975). The concept of a linguistic variable and its application to approximate reasoning [Parts 1, 2, 3].Information Sciences,8, 199;8, 301; 9, 43.
Zimmer, A. C. (1983). Verbal versus numerical processing of subjective probabilities. In R. W. Scholz (Ed.),Decision making under uncertainty (pp. 159–182). Amsterdam: North-Holland.
Zwick, R., Carlstein, E., &Budescu, D. V. (1987). Measures of similarity among fuzzy concepts: A comparative analysis.International Journal of Approximate Reasoning,1, 221–242.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by NSF Grant 0196140, awarded to the second author.
Rights and permissions
About this article
Cite this article
Dhami, M.K., Wallsten, T.S. Interpersonal comparison of subjective probabilities: Toward translating linguistic probabilities. Memory & Cognition 33, 1057–1068 (2005). https://doi.org/10.3758/BF03193213
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03193213