Skip to main content

Empirical Comparison of Lottery- and Rating-Based Preference Assessment

  • Chapter
Book cover Aiding Decisions with Multiple Criteria

Part of the book series: International Series in Operations Research & Management Science ((ISOR,volume 44))

  • 299 Accesses

Abstract

We investigate the performance of direct rating, probability equivalent, and lottery equivalent assessment techniques for a set of 41 individuals in terms of the ability of the techniques to reproduce indifference between two-criteria outcomes previously judged to be indifferent. To compare the performance before and after gaining familiarity with the techniques, we use data obtained both at the beginning and at the end of the interview sessions. The results show that the probability equivalent and lottery equivalent techniques performed no worse, and generally better than the rating technique. These results refute claims that lottery-based techniques are too complicated and too unrealistic compared to simpler techniques to be used in MCDA preference assessment. The results also show that all three techniques performed better when using data obtained at the end of the session—after the individuals gained familiarity with the techniques—and that the relatively complex lottery equivalent technique performed as well as the other techniques when using data obtained at the end of the session.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Allais, M. “The So-Called Allais Paradox and Rational Decisions Under Uncertainty,” Expected Utility Hypotheses and the Allais Paradox. M. Allais and O. Hagen (eds.), D. Reidel, Dordrecht, NL, 1979, pp. 437–682.

    Chapter  Google Scholar 

  • Franzese, O. Errors and Impacts of Preference Assessments in a Multiattribute Utility Framework. Ph.D. dissertation, The Ohio State University, Columbus, OH, USA, 1993.

    Google Scholar 

  • Fischhoff, B, N. Welch, and S. Frederick, “Construal Processes in Preference Assessment,” Risk and Uncertainty, 19:1–3, pp. 139–64, 1999.

    Article  Google Scholar 

  • French, S., Decision Theory: An Introduction to the Mathematics of Rationality. Ellis Horwood, Chichester, UK, 1986.

    Google Scholar 

  • Larson, R. and A. Odoni, Urban Operations Research. Prentice-Hall, 1981.

    Google Scholar 

  • Law, A., D. Pathak, and M. McCord, “Health Status Utility Assessment by Standard Gamble: A Comparison of the Probability Equivalence and the Lottery Equivalence Approaches,” Pharmaceutical Research, 15(1), 1998, pp. 105–109.

    Article  Google Scholar 

  • McCord, M. R. and O. Franzese, “Empirical Evidence of Two-Attribute Utility on Probability,” Theory and Decision, 35, pp. 337–51, 1993.

    Article  Google Scholar 

  • McCord, M. R., O. Franzese, and X. D. Sun, “Multicriteria Analysis of Aeromedical Fleet Expansion,” Journal of Applied Mathematics and Computing, 54(2 & 3), pp. 101–29, 1993.

    Google Scholar 

  • McCord, M. R. and A.Y.C. Leu, “Sensitivity of Optimal Hazmat Routes to Limited Preference Specification,” Information Systems and Operational Research, 33(2), pp. 68–83, 1995.

    Google Scholar 

  • McCord, M. R. and R. de Neufville, “Lottery Equivalents: Reduction of the Certainty Effect Problem in Utility Assessment,” Management Science, 32(1), pp. 56–60, 1986.

    Article  Google Scholar 

  • McCord, M. R. and R. de Neufville, “Assessment Response Surface: Investigating Utility Dependence on Probability,” Theory and Decision, 18, pp. 263–285, 1985.

    Article  Google Scholar 

  • McCord, M. R. and R. de Neufville, “Empirical Demonstration that Expected Utility Decision Analysis is not Operational,” Foundations of Utility and Risk Theory with Applications, pp. 181–199, B. P. Stigum and F. Wenstop (eds.), D. Reidel, Dordrecht, NL, 1983.

    Google Scholar 

  • Payne, J. W., J. R. Bettman, and D. A. Schkade, “Measuring Constructed Preferences: Towards a Building Code,” Risk and Uncertainty, 19:1–3, pp. 243–70, 1999.

    Article  Google Scholar 

  • Rogers, M., M. Bruen, and L.-Y. Maystre, ELECTRE and Decision Support: Methods and Applications in Engineering and Infrastructure Investment. Kluwer Academic Publishers, Boston USA, 2000, 208 pp.

    Google Scholar 

  • Roy, B., Multicriteria Methodology for Decision Aiding. Kluwer Academic Publishers, Dordrecht, NL, 1996, 292 pp.

    Book  Google Scholar 

  • von Winterfeldt, D. and W. Edwards, Decision Analysis and Behavioral Analysis. Cambridge University Press, Cambridge, England, 1986.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Denis Bouyssou Eric Jacquet-Lagrèze Patrice Perny Roman Słowiński Daniel Vanderpooten Philippe Vincke

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer Science+Business Media New York

About this chapter

Cite this chapter

Franzese, O., McCord, M.R. (2002). Empirical Comparison of Lottery- and Rating-Based Preference Assessment. In: Bouyssou, D., Jacquet-Lagrèze, E., Perny, P., Słowiński, R., Vanderpooten, D., Vincke, P. (eds) Aiding Decisions with Multiple Criteria. International Series in Operations Research & Management Science, vol 44. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-0843-4_15

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-0843-4_15

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-5266-2

  • Online ISBN: 978-1-4615-0843-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics