Skip to main content
SpringerLink
Log in
Book cover

Expert Judgment and Expert Systems pp 251–267Cite as

Assessing the Effectiveness of Expert Teams

  • Conference paper

Part of the book series: NATO ASI Series ((NATO ASI F,volume 35))

Abstract

The earliest literature concerning collective judgment consistently indicated that groupings of experts should be expected to outperform their average member, but there is little evidence available to suggest that the quality of collective judgment is substantially improved by any particular method of aggregation (Rohrbaugh, 1979, 1981). Fischer (1981) has concluded:

From a practical standpoint it makes little or no difference how one aggregates the conflicting opinions of experts. Any reasonable approach is likely to be as good as any other.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Boring, E. G. The nature and the history of experimental control. American Journal of Psychology, 1954, 67, 573–589.

    Article  Google Scholar 

  • Campbell, D. T., and Stanley, J. C. Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (ed.), Handbook of research on teaching. Chicago: Rand McNally, 1963.

    Google Scholar 

  • Fischer, G. W. When oracles fail—a comparison of four procedures for aggregating subjective probability forecasts. Organizational Behavior and Human Performance. 1981, 28, 96–110.

    Article  Google Scholar 

  • Gouldner, A. W. Organizational analysis. In R. Merton, L. Broom, and L. S. Cottrell Jr. (eds.), Sociology today: Problems and prospects. New York: Basic Books, 1959.

    Google Scholar 

  • Hart, S. L. Toward quality criteria for collective judgments. Organizational Behavior and Human Decision Processes, 1985, 36, 209–228.

    Article  Google Scholar 

  • Lewin, A. Y., and Minton, J. W. Determining organizational effectiveness: Another look, and an agenda for research. Management Science, 1986, 32, 514–538.

    Article  Google Scholar 

  • Milter, R. G. An exploration of criteria for effective decision making in organizations and an evaluation of a group decision support system: A case study approach. An unpublished doctoral dissertation, Department of Public Administration, State University of New York at Albany, August, 1986.

    Google Scholar 

  • Parsons, T. General theory in sociology. In R. Merton, L. Broom, and L. S. Cottrell Jr. (eds.), Sociology today: Problems and prospects. New York: Basic Books, 1959.

    Google Scholar 

  • Quinn, R. E., and Rohrbaugh, J. A competing values approach to organizational effectiveness. Public Productivity Review, 1981, 5, 122–140.

    Article  Google Scholar 

  • Quinn, R. E., and Rohrbaugh, J. A spatial model of effectiveness criteria: Toward a competing values approach to organizational analysis. Management Science, 1983, 29, 363–377.

    Article  Google Scholar 

  • Quinn, R. E., Rohrbaugh, J., and McGrath, M. R. Automated decision conferencing: How it works. Personnel, 1985, 62, 49–55.

    Google Scholar 

  • Rohrbaugh, J. Improving the quality of group judgment: Social judgment analysis and the Delphi technique. Organizational Behavior and Human Performance, 1979, 24, 73–92.

    Article  Google Scholar 

  • Rohrbaugh, J. Improving the quality of group judgment: Social judgment analysis and the Nominal Group Technique. Organizational Behavior and Human Performance. 1981, 28, 272–288.

    Article  Google Scholar 

  • Rohrbaugh, J. The use of computers for improving decison making in organizations: Beyond “exhaustive” empiricism and “bounded” rationality. Paper presented at the 1986 Conference on Decision Making and Information Processing, School of Management, State University of New York at Buffalo.

    Google Scholar 

  • Tryfos, P., Casey, S., Cook, S., Leger, G., and Pylypiak, B. The profitability of wagering on NFL games. Management Science, 1984, 30, 123–132.

    Article  Google Scholar 

  • Zakay, D. The evaluation of managerial decisions’ quality by managers. Acta Psychological 1984, 56, 49–57.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Rockefeller College of Public Affairs and Policy, State University of New York at Albany, Albany, NY, USA

    John Rohrbaugh

Authors
  1. John Rohrbaugh
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Public Administration, Rockefeller College, State University of New York, 12222, Albany, NY, USA

    Jeryl L. Mumpower (Associate Professor) (Associate Professor)

  2. Clark University, Worcester, MA, 01610, USA

    Ortwin Renn (Associate Professor of Environment Technology, and Society) (Associate Professor of Environment Technology, and Society)

  3. Decision Analysis Unit, London School of Economics and Political Science, Houghton St., WC2A 2AE, UK

    Lawrence D. Phillips (Director) (Director)

  4. Mathematics and Statistics, Research Department, Oak Ridge National Laboratory, Oak Ridge, TN, 37830, USA

    V. R. R. Uppuluri (Director) (Director)

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rohrbaugh, J. (1987). Assessing the Effectiveness of Expert Teams. In: Mumpower, J.L., Renn, O., Phillips, L.D., Uppuluri, V.R.R. (eds) Expert Judgment and Expert Systems. NATO ASI Series, vol 35. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-86679-1_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-86679-1_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-86681-4

  • Online ISBN: 978-3-642-86679-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation