Skip to main content
SpringerLink
Log in

A Brief History of the Relationship Between Expertise and Artificial Intelligence

  • Chapter
  • First Online:
Expertise at Work

Abstract

This chapter presents a brief history of expertise studies and artificial intelligence (AI) from a joint cognitive systems viewpoint. Expertise is currently viewed as a skilled adaptation to complexity and novelty. Artificial intelligence, when restricted to machine learning systems, results in brittle systems that cannot cope with unanticipated variability and hence do not match human experts’ competencies. In order to effectively collaborate with human experts, AI requires collaborative skills, such as being able to explain itself. On the other hand, the introduction of AI also results in a series of new skills that human experts need to develop in order to deal with AI. We argue for a joint cognitive systems perspective, allowing us to see the intricacies of the mutual dependencies between humans and AI, and the constantly evolving distribution of skill sets that are required from an organizational perspective. We illustrate the general principles described above through a case study in radiology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Anderson, J. R. (1981). Cognitive skills and their acquisition. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Bainbridge, L. (1983). Ironies of automation. Automatica, 19(6), 775–779.

    Article  Google Scholar 

  • Billings, C. (1991). Human-centered aircraft automation: A concept and guidelines. NASA Tech Memo 103885. Springfield, VA: National technical information service.

    Google Scholar 

  • Bobrow, D. G. (1984). Qualitative reasoning about physical systems: An introduction. Artificial intelligence, 24(1–3), 1–5.

    Article  Google Scholar 

  • Bostrom, N. (2017). Superintelligence. Paris: Dunod.

    Google Scholar 

  • Bradshaw, J. M., Hoffman, R. R., Johnson, M., & Woods, D. D. (2013). The seven deadly myths of “autonomous systems”. IEEE Intelligent Systems, 28(3), 54–61.

    Article  Google Scholar 

  • Brooks, R. A. (1990). Elephants don’t play chess. Robotics and autonomous systems, 6(1–2), 3–15.

    Article  Google Scholar 

  • Brown, N., & Sandholm, T. (2018). Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science, 359(6374), 418–424.

    Article  Google Scholar 

  • Campbell, M., Hoane, A. J., Jr., & Hsu, F. H. (2002). Deep blue. Artificial Intelligence, 134(1–2), 57–83.

    Article  Google Scholar 

  • Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.

    Article  Google Scholar 

  • Chen, Y., Elenee Argentinis, J., & Weber, G. (2016). IBM Watson: How cognitive computing can be applied to big data challenges in life sciences research. Clinical Therapeutics, 38(4), 688–701.

    Article  Google Scholar 

  • Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5, 121–125.

    Article  Google Scholar 

  • Chi, M. T. H., Glaser, R., & Farr, M. J. (1988). The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Christoffersen, K., & Woods, D. D. (2002). How to make automated systems team players. In E. Salas (Ed.), Advances in human performance and cognitive engineering research (Vol. 2, pp. 1–12). Kidlington, UK: Elsevier Science.

    Chapter  Google Scholar 

  • Daugherty, P. R., & Wilson, H. J. (2018). Human + Machine: Reimagining work in the age of AI. Cambridge, MA: Harvard Business Review Press.

    Google Scholar 

  • Davis, R. (1984). Amplifying expertise with expert systems. In P. H. Winston & K. A. Prendergast (Eds.), The AI Business: commercial uses of artificial intelligence (pp. 17–40). Cambridge, MA: MIT Press.

    Google Scholar 

  • de Groot, A. D. (1946). Het denken van den schaker. Amsterdam: Noord Hollandsche.

    Google Scholar 

  • de Groot, A. D. (1965). Thought and choice in chess (first Dutch edition in 1946). Mouton Publishers.

    Google Scholar 

  • Ericsson, K. A. (2006). An introduction to The Cambridge Handbook of Expertise and Expert Performance: Its development, organization, and content. In K. Anders Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 3–19). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • European Commission. (2019, April 8). A definition of AI: Main capabilities and disciplines. Independent high-level expert group on artificial intelligence. Brussels: European Commission. Retrieved from https://ec.europa.eu/digital-single-market/en/news/definition-artificial-intelligence-main-capabilities-and-scientific-disciplines

  • Feigenbaum, E. A. (1989). What hath Simon wrought? In D. Klahr & K. Kotovsky (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 165–182). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Feigenbaum, E. A., McCorduck, P., & Nii, H. P. (1988). The rise of the expert company. New York: Times Books.

    Google Scholar 

  • Feltovich, P. J., Prietula, M. J., & Anders Ericsson, K. (2006). Studies of expertise from psychological perspectives. In K. Anders Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 41–67). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Ferrucci, D. A. (2012). Introduction to “This is Watson”. IBM Journal of Research and Development, 56. (3.4), 1, 1–1:15.

    Google Scholar 

  • Germain, M.-L. (2006, February). Stages of psychometric measure development: The Example of the Generalized Expertise Measure (GEM). Paper presented at the Academy of Human Resource Development International Conference, Columbus, OH. Retrieved from http://www.eric.ed.gov/PDFS/ED492775.pdf

  • Germain, M.-L., & Tejeda, M. J. (2012). A preliminary exploration on the measurement of expertise: An initial development of a psychometric scale. Human Resource Development Quarterly, 23, 203–232.

    Article  Google Scholar 

  • Glaser, R., & Chi, M. T. H. (1988). Overview. In M. T. H. Chi, R. Glaser, & M. Farr (Eds.), The nature of expertise (pp. xv–xxviii). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Gobet, F. (2020). The classic expertise approach and its evolution. In P. Ward, J. M. C. Schraagen, J. Gore, & E. M. Roth (Eds.), The Oxford handbook of expertise (pp. 35–55). Oxford, UK: Oxford University Press.

    Google Scholar 

  • Goldstein, I., & Papert, S. (1977). Artificial intelligence, language, and the study of knowledge. Cognitive Science, 1(1), 84–123.

    Article  Google Scholar 

  • Gottfredson, L. S. (1997). Mainstream science on intelligence: An editorial with 52 signatories, history, and bibliography. Intelligence, 24, 13–23.

    Article  Google Scholar 

  • Grenier, R. S., & Germain, M.-L. (2014). Expertise through the HRD lens: Research trends and implications. In N. F. Chalofsky, T. S. Rocco, & M. L. Morris (Eds.), Handbook of Human Resource Development (pp. 183–200). Hoboken, NJ: John Wiley & Sons.

    Google Scholar 

  • Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge Acquisition, 5(2), 199–220.

    Article  Google Scholar 

  • Gunning, D., & Aha, D. W. (2019). DARPA’s explainable artificial intelligence program. AI Magazine, 40(2), 44–58.

    Article  Google Scholar 

  • Hambrick, D. Z., Burgoyne, A. P., & Oswald, F. L. (2020). Domain-general models of expertise: The role of cognitive ability. In P. Ward, J. M. C. Schraagen, J. Gore, & E. M. Roth (Eds.), The Oxford handbook of expertise (pp. 56–84). Oxford, UK: Oxford University Press.

    Google Scholar 

  • Hatano, G., & Inagaki, K. (1986). Two courses of expertise. In H. Stevenson, H. Azuma, & K. Hakuta (Eds.), Child development and education in Japan (pp. 262–272). New York: W. H. Freeman.

    Google Scholar 

  • Holyoak, K. (1991). Symbolic connectionism: toward third-generation theories of expertise. In K. Anders Ericsson & J. Smith (Eds.), Toward a general theory of expertise: Prospects and limits (pp. 301–335). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., & Aerts, H. J. (2018). Artificial intelligence in radiology. Nature Reviews Cancer, 18(8), 500–510.

    Article  Google Scholar 

  • Hunt, E. (2006). Expertise, talent, and social encouragement. In K. Anders Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 31–38). Cambridge, UK: Cambridge University Press.

    Chapter  Google Scholar 

  • Johnson, J. G., & Raab, M. (2003). Take the first: Option-generation and resulting choices. Organizational Behavior and Human Decision Processes, 91, 215–229.

    Article  Google Scholar 

  • Johnson, M., & Vera, A. (2019). No AI is an island: The case for teaming intelligence. AI Magazine, 40(1), 16–28.

    Article  Google Scholar 

  • Klein, G., Wolf, S., Militello, L., & Zsambok, C. (1995). Characteristics of skilled option generation in chess. Organizational Behavior and Human Decision Processes, 62(1), 63–69.

    Article  Google Scholar 

  • Klein, G., Woods, D. D., Bradshaw, J., Hoffman, R. R., & Feltovich, P. J. (2004). Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intelligent Systems, 91–95.

    Google Scholar 

  • Leith, P. (2016). The rise and fall of the legal expert system. International Review of Law, Computers & Technology, 30(3), 94–106.

    Article  Google Scholar 

  • Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, D., & Wang, Y. (1988). Expertise in a complex skill: Diagnosing x-ray pictures. In M. T. H. Chi, R. Glaser, & M. Farr (Eds.), The nature of expertise (pp. 311–342). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Mamede, S., Schmidt, H. G., Rikers, R. M. J. P., Custer, E. J. F. M., Splinter, T. A. W., & Van Saase, J. L. C. M. (2010). Conscious thought beats deliberation without attention in diagnostic decision-making: At least when you are an expert. Psychological Research, 74, 586–592.

    Article  Google Scholar 

  • Marcus, G., & Davis, E. (2019). Rebooting AI: Building artificial intelligence we can trust. New York: Random House.

    Google Scholar 

  • Minsky, M., & Papert, S. A. (1972). Artificial intelligence progress report.

    Google Scholar 

  • Moosavi-Dezfooli, S. M., Fawzi, A., & Frossard, P. (2016). Deepfool: A simple and accurate method to fool deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2574–2582).

    Google Scholar 

  • Moxley, J. H., Anders Ericsson, K., Charness, N., & Krampe, R. T. (2012). The role of intuition and deliberative thinking in experts’ superior tactical decision-making. Cognition, 124, 72–78.

    Article  Google Scholar 

  • Nilsson, N. J. (2009). The quest for artificial intelligence. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Norman, G. R., Coblentz, C. L., Brooks, L. R., & Babcook, C. J. (1992). Expertise in visual diagnosis: A review of the literature. Academic Medicine, 67(10), S78–S83.

    Article  Google Scholar 

  • Patel, V. L., Kaufman, D. R., & Kannampallil, T. G. (2020). Diagnostic reasoning and expertise in healthcare. In P. Ward, J. M. Schraagen, J. Gore, & E. Roth (Eds.), The Oxford handbook of expertise (pp. 618–641). Oxford, UK: Oxford University Press.

    Google Scholar 

  • Pearl, J., & Mackenzie, D. (2018). The book of why: The new science of cause and effect. New York: Basic Books.

    Google Scholar 

  • Peeters, M. M. M., van Diggelen, J., van den Bosch, K., Bronkhorst, A., Neerincx, M. A., Schraagen, J. M., & Raaijmakers, S. (2020). Hybrid collective intelligence in a human-AI society. AI & Society. https://doi.org/10.1007/s00146-020-01005-y

  • Quillian, R. (1963). A notation for representing conceptual information: An application to semantics and mechanical English para-phrasing. SP-1395, System Development Corporation.

    Google Scholar 

  • Roth, E. M., Bennett, K. B., & Woods, D. D. (1987). Human interaction with an “intelligent” machine. International Journal of Man-Machine Studies, 27, 479–525.

    Article  Google Scholar 

  • Sarter, N., & Woods, D. D. (1995). “How in the world did we get into that mode?” Mode error and awareness in supervisory control. Human Factors, 37, 5–19.

    Article  Google Scholar 

  • Schraagen, J. M. C. (2018). Naturalistic decision making. In L. J. Ball & V. A. Thompson (Eds.), The Routledge international handbook of thinking and reasoning (pp. 487–501). London: Routledge.

    Google Scholar 

  • Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., Chen, Y., Lillicrap, T., Hui, F., Sifre, L., van den Driesse, G., Graepel, T., & Hassabis, D. (2017). Mastering the game of Go without human knowledge. Nature, 550(7676), 354–359.

    Article  Google Scholar 

  • Simon, H. A., & Gilmartin, K. (1973). A simulation of memory for chess positions. Cognitive Psychology, 5, 29–46.

    Article  Google Scholar 

  • van Harmelen, F., & Teije, A. T. (2019). A boxology of design patterns for hybrid learning and reasoning systems. arXiv preprint arXiv:1905.12389.

    Google Scholar 

  • Vergne, M. (2017). Artificial Intelligence and expertise: The two faces of the same artificial performance coin. In Proceedings of the AAAI-17 Workshop on Human-Machine Collaborative Learning (pp. 696–702).

    Google Scholar 

  • Ward, P., Gore, J., Hutton, R., Conway, G., & Hoffman, R. (2018). Adaptive skill as the conditio sine qua non of expertise. Journal of Applied Research in Memory and Cognition, 7(1), 35–50.

    Article  Google Scholar 

  • Ward, P., Schraagen, J. M. C., Gore, J., Roth, E. M., Hoffman, R. R., & Klein, G. (2020). Reflections on the study of expertise and its implications for tomorrow’s world. In P. Ward, J. M. C. Schraagen, J. Gore, & E. M. Roth (Eds.), The Oxford handbook of expertise (pp. 1193–1213). Oxford University Press.

    Google Scholar 

  • Wiener, E. L. (1989). Human factors of advanced technology (“glass cockpit”) transport aircraft (NASA Contractor Report No. 177528). NASA Ames Research Center.

    Google Scholar 

  • Woods, D. D. (2016). The risks of autonomy: Doyle’s catch. Journal of Cognitive Engineering and Decision Making, 10(2), 131–133.

    Article  Google Scholar 

  • Woods, D. D., Dekker, S., Cook, R., Johannesen, L., & Sarter, N. (2010). Behind human error (2nd ed.). Farnham, UK: Ashgate Publishing Limited.

    Google Scholar 

  • Woods, D. D., & Hollnagel, E. (2006). Joint cognitive systems: Patterns in cognitive systems engineering. Boca Raton, FL: CRC Press.

    Book  Google Scholar 

  • Woodworth, R. S., & Schlosberg, H. (1954). Experimental psychology (Rev. ed.). New York: Henry Holt and Company.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. TNO (The Netherlands Organisation for Applied Scientific Research), Soesterberg, The Netherlands

    Jan Maarten Schraagen & Jurriaan van Diggelen

Authors
  1. Jan Maarten Schraagen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jurriaan van Diggelen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan Maarten Schraagen .

Editor information

Editors and Affiliations

  1. Western Carolina University, Cullowhee, NC, USA

    Marie-Line Germain

  2. University of Connecticut, Storrs, CT, USA

    Robin S. Grenier

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Schraagen, J.M., van Diggelen, J. (2021). A Brief History of the Relationship Between Expertise and Artificial Intelligence. In: Germain, ML., Grenier, R.S. (eds) Expertise at Work. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-64371-3_8

Download citation

Publish with us

Policies and ethics

Search

Navigation