Building Models of Expertise

  • Nigel Shadbolt


The development and use of expert systems has grown rapidly since the early 1980s. Such systems are increasingly employed by industrial firms. Expert systems (also called knowledge-based systems) are computer based systems that exhibit levels of performance comparable with human experts in some specified domain of application. Knowledge engineering is an emerging discipline which underpins the development of expert systems. It is arguably the most technologically sophisticated approach to expertise currently available. Consequently an overview of some of the problems that beset knowledge engineering is of direct relevance to a more general discussion on the nature of expertise. This chapter is structured around a set of problems that dominate the current state of the art in knowledge acquisition (KA), an important part of knowledge engineering.


Expert System Knowledge Acquisition Knowledge Engineering Knowledge Engineer Integrate Knowledge Interpreter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. ANJEWIERDEN, A., WIELEMAKER, J. and TOUSSAINT, C. (1990) ‘SHELLEY — Computer Aided Knowledge Engineering’, in B. Wielinga, J. Boose, B. Gaines, G. Schreiber and M. van Someren, (eds), Current Trends in Knowledge Acquisition, Amsterdam: IOS Press. pp. 141–59.Google Scholar
  2. BOOSE, J. H., SHEMA, D. B and BRADSHAW, J. M. (1989) ‘Recent Progress in AQUINAS: a Knowledge Acquisition Workbench’, Knowledge Acquisition, Vol. 1(2), Academic Press, London.Google Scholar
  3. BYLANDER, T. and CHANDRASEKARAN, B. (1988) ‘Generic Tasks in Knowledge-based Reasoning: The ‘Right’ Level of Abstraction for Knowledge Acquisition, in B. Gaines and J. Boose, (eds), Knowledge Acquisition for Knowledge Based Systems, Vol. 1, pp. 65–77, Academic Press, London.Google Scholar
  4. CHASE, W. G. and SIMON, H. A. (1973) ‘Perception in Chess,’ Cognitive Psychology, 4, pp. 55–81.CrossRefGoogle Scholar
  5. CHI, M., GLASER, R. and FARR, M. (eds) (1988) The Nature of Expertise (New Jersey: LEA).Google Scholar
  6. CLANCEY, W. (1985) ‘Heuristic Classification’ Artificial Intelligence, 27, pp. 289–350.CrossRefGoogle Scholar
  7. CLEAVES, D. A. (1987) ‘Cognitive Biases and Corrective Techniques: Proposals for Improving Elicitation Procedures for Knowledge-Based Systems’, International Journal of Man-Machine Studies, 27, pp. 155–66.CrossRefGoogle Scholar
  8. ESHELMAN, L. (1989) ‘MOLE: A Knowledge-Acquisition Tool for Cover-and-Differentiate Systems’, in S. Marcus, (ed.), Automating Knowledge Acquisition for Expert Systems (Dordrecht: Kluwer Academic Publishers) pp. 37–80.Google Scholar
  9. GAINES, B. R. and SHAW, M. L. G. (1986) ‘Induction of Inference Rules for Expert Systems’, Fuzzy Sets and Systems, 8(3) pp. 315–28.CrossRefGoogle Scholar
  10. GINSBERG, M. L. (1991) ‘Knowledge Interchange Format: The KIF of Death’, AI Magazine, 12(3), pp. 57–63.Google Scholar
  11. HINK, R. F. and WOODS, D. L. (1987) ‘How Humans Process Uncertain Knowledge’, AI Magazine, 8, pp. 41–53.Google Scholar
  12. HOFFMAN, R. R. (1987) ‘The Problem of Extracting the Knowledge of Experts from the Perspective of Experimental Psychology’, AI Magazine, 8, pp. 53–66.Google Scholar
  13. JOHNSON-LAIRD, P. N. (1983) Mental Models (Cambridge. Cambridge University Press).Google Scholar
  14. KAHN, G., NOWLAN, S. and McDERMOTT, J. (1985) ‘MORE: an Intelligent Knowledge Acquisition Tool’, Proceedings of the 9th International Joint Conference on Artificial Intelligence, pp. 581–4.Google Scholar
  15. KAHNEMAN, D., SLOVIC, P. and TVERSKY, A. (eds) (1982) Judgement Under Uncertainty: Heuristics and Biases (New York: Cambridge University Press).Google Scholar
  16. KARBACH, W., LINSTER, M. and VOSS, A. (1990) ‘Model-Based Approaches: One Label — One Idea?’ in B. Wielinga, J. Boose, B. Gaines, G. Schreiber and M. van Someren, (eds), Current Trends in Knowledge Acquisition (Amsterdam: IOS Press). pp. 173–89.Google Scholar
  17. LESGOLD, A., RUBINSON, H., FELTOVICH, P., GLASER, R., KLOPFER, D. and WANG, Y (1988) ‘Expertise in a Complex Skill: Diagnosing X-ray Pictures’, in Chi, M. T. H., Glaser, R. and Farr, M. J. (eds) The Nature of Expertise (London: Lawrence Erlbaum) pp. 311–42.Google Scholar
  18. McALLESTER, D. ( 1980) ‘An Outlook on Truth Maintenance’. Technical Report No. AIM-551, Artificial Intelligence Laboratory, Massachusetts Institute of Technology.Google Scholar
  19. MARCUS, S. (1988) Automatic Knowledge Acquisition for Expert Systems (New York: Kluwer).CrossRefGoogle Scholar
  20. MEYER, M. A., BOOKER, J. M. and BRADSHAW, J. M. (1990) ‘A Flexible Six-step Program for Defining and Handling Bias in Knowledge Elicitation’, in B. Wielinga, J. Boose, B. Gaines, G. Schreiber, M. van Someren, (eds), Current Trends in Knowledge Acquisition (Amsterdam: IOS Press). pp. 237–56.Google Scholar
  21. MEYER, M and BOOKER, J. (1991) Eliciting and Analysing Expert Judgement: a Practical Guide, Knowledge Based Systems, Vol. 5 (London: Academic Press).Google Scholar
  22. MOTTA, E., O’HARA, K. and SHADBOLT, N. (1994) ‘Grounding GDMs: A Structured Case Study’. International Journal of Human-Computer Studies, 40 (1994) pp. 315–47.CrossRefGoogle Scholar
  23. MOTTA, E., RAJAN, T., DOMINGUE, J. and EISENSTADT, M. (1990) ‘Methodological Foundations of KEATS, the Knowledge Engineer’s Assistant’, in B. Wielinga, J. Boose, B. Gaines, G. Schreiber and M. van Someren, (eds), Current Trends in Knowledge Acquisition, (Amsterdam: IOS Press) pp. 257–75.Google Scholar
  24. MOTTA, E., STUTT, A., ZDRAHAL, Z., O’HARA, K. and SHADBOLT, N. R (1996) ‘Solving VT in VITAL: a Study in Model Construction and Knowledge Reuse’, International Journal of Human-Computer Studies, 44(3/4) (1996) pp. 333–71.CrossRefGoogle Scholar
  25. MUSEN, M. A., FAGIN, L. M., COMBS, D. M. and SHORTLIFFE, E. H. (1987) ‘Use of a Domain Model to Drive an Interactive Knowledge-Editing Tool’, International Journal of Man-Machine Studies, 26, pp. 105–21.CrossRefGoogle Scholar
  26. NECHES, R., FIKES, R., FININ, T., GRUBER, T., PATIL, R., SENATOR, T. and SWARTOUT, W (1991) ‘Enabling Technology for Knowledge Sharing’, AI Magazine, 12(3), pp. 36–56.Google Scholar
  27. REICHGELT, H. and SHADBOLT, N. R. (1991) ‘ProtoKEW: A Knowledge-Based System for Knowledge acquisition’, in D, Sleeman and N. Bernsen, (eds) Research Directions in Cognitive Science Volume 5: Artificial Intelligence. Lawrence Erlbaum. pp. 171–202.Google Scholar
  28. RIPS, L. J. and MARCUS, S. L. (1977) ‘Supposition and the Analysis of Conditional Sentences’, in M. A. Just and P. A. Carpenter (eds), Cognitive Processes in Comprehension (Hillsdale, NJ: Erlbaum).Google Scholar
  29. RUGG, G and SHADBOLT, N. (1991) ‘On the Limitations of the Repertory Grid Technique’, Technical report, AI Group, Dept Psychology, University of Nottingham.Google Scholar
  30. SCHREIBER, A. Th., WIELINGA, B. and BREUKER, J. A. (1993) (eds), ‘KADS: A Principled Approach to Knowledge-Based System Development’, Knowledge-Based Systems Book Series Vol. II, (London: Academic Press).Google Scholar
  31. SHADBOLT, N. R. and BURTON, M. (1995) ‘Knowledge Elicitation: a Systematic Approach’, in Evaluation of Human work: A Practical Ergonomics Methodology. J. R. Wilson and E. N. Corlett (eds), (London: Taylor and Francis, 1995). pp. 406–40.Google Scholar
  32. SHADBOLT, N., MOTTA, E. and ROUGE, A. (1993) ‘Constructing Knowledge-Based Systems’. IEEE Software, November 1993, pp. 34–9.Google Scholar
  33. SHADBOLT, N. R. and O’HARA, K. (1997) ‘Model-Based Expert Systems and the Explanation of Expertise’, in Paul Feltovich, Ken Ford and Robert Hoffman (eds), Expertise in Context. Cambridge, Mass.: AAAI and MIT Press, pp. 315–37.Google Scholar
  34. SHADBOLT, N. and WIELINGA, B. (1990) ‘Knowledge Based Knowledge Acquisition: The Next Generation of Support Tools’, in B. Wielinga, J. Boose, B. Gaines, G. Schreiber and M. van Someren, (eds), Current Trends in Knowledge Acquisition, (Amsterdam: IOS Press) pp. 313–38.Google Scholar
  35. SLATTER, P. E. (1987) Building Expert Systems: Cognitive Emulation (Chichester: Ellis Horwood).Google Scholar
  36. STEELS, L. (1990) ‘Components of expertise’, The AI Magazine, 11 pp. 30–62.Google Scholar
  37. TERPSTRA, P., VAN HEIJST, G., SHADBOLT, N. and WIELINGA, B, (1993) ‘Knowledge Acquisition Process Support Through Generalised Directive Models’, in David, J.-M., Krivine, J.-P. and Simmons, R. (eds), Second Generation Expert Systems, Berlin: Springer-Verlag. pp. 428–55.CrossRefGoogle Scholar
  38. WASON, P. C. (1961) ‘Response to Affirmative and Negative Binary Statements’, British Journal of Psychology, 52, pp. 273–81.CrossRefGoogle Scholar

Copyright information

© Nigel Shadbolt 1998

Authors and Affiliations

  • Nigel Shadbolt

There are no affiliations available

Personalised recommendations