Expert Systems Evaluation Proposal

  • Paula Miranda
  • Pedro Isaias
  • Manuel Crisostomo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4557)

Abstract

It is well recognized that the evaluation of the expert systems is very important and difficult. This paper relates to the important issue of Expert System evaluation. A methodology for addressing the problem is presented. As evaluation model is proposed with the following main criteria: Usability; impact of the system in the behaviour and decisions of the user; Impact of the quality of the information provided to the user; financial impact; usefulness.

Keywords

Expert systems evaluation criteria quality 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Okogbaa, G.: Evaluation of Manufacturing Expert Systems: Framework and Model, Engineering Economist (1992)Google Scholar
  2. 2.
    Sørgaard, P.: Evaluating Expert System Prototypes, AI & Society, vol. 5(1). Springer, Heidelberg (1991)Google Scholar
  3. 3.
    Turban, E., Aronson, J.E.: Decision Support and Intelligent Systems, 6th edn. Prentice Hall, New Jersey (2000)Google Scholar
  4. 4.
    Yang, C., Kose, S., Phan, S., Kuo, P.: A Simulation-based Procedure for Expert System Evaluation. In: Proceedings of the IEA/AIE 13th International Conference, New Orleans (June 19-22, 2000)Google Scholar
  5. 5.
    Alves, J.: Avaliação do Desempenho de Sistemas Periciais, Tese de Mestrado, Universidade Nova de Lisboa, Instituto Superior de Economia e Gestão (2004)Google Scholar
  6. 6.
    Wentworth, J., Knaus, R., Aougab, H.: Verification, Validation, and Evaluation of Expert Systems, An FHWA Handbook, vol. I (1995)Google Scholar
  7. 7.
    ISO/DIS 9241-11, in European Usability Support CentreGoogle Scholar
  8. 8.
    Carvalho, A.: Testes de Usabilidade: exigência supérflua ou necessidade? In: Actas do 5º Congresso da Sociedade Portuguesa de Ciências da Educação., pp. 235–242. Sociedade Portuguesa de Ciências da Educação, Lisboa (2002)Google Scholar
  9. 9.
    Carvalho, A.: Avaliar a Usabilidade da Plataforma FLEXML: Descrição Dos Testes Realizados Com Utilizadores, VII Congresso Iberoamericano de Informática Educativa, pp. 197–206 (2004)Google Scholar
  10. 10.
    Cascante, P., Plaisent, M., Bernard, P., Maguiraga, L.: The Impact f Expert Decisions Support Systems of the Performance of New Employees. Information Resources Management Journal 14(4), 64–78 (2002)Google Scholar
  11. 11.
    Grier, A., Hsiao, R.: A Decision Support Expert System for Correction of Manufacturing Process Problems. In: Proceedings of the 3rd International Conference on Industrial Engineering Applications of Artificial Intelligence and Expert Systems, Charleston, South Carolina, United States. IEA/AIE, vol. 1, ACM Press, New York (1990)CrossRefGoogle Scholar
  12. 12.
    Cojocariu, A., Munteanu, A., Sofran, O.: Verification, Validation and Evaluation of Expert Systems in Order to Develop a Safe in the Processo f Decison Making, Computational Economics 0510002, EconWPA (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Paula Miranda
    • 1
  • Pedro Isaias
    • 2
  • Manuel Crisostomo
    • 3
  1. 1.Escola Superior de Tecnologia de Setúbal, Instituto Politécnico de Setúbal, Campus do IPS, Estefanilha, 2910-761 SetúbalPortugal
  2. 2.Universidade Aberta, Rua Fernão Lopes, 9, 1º Esq., 100-132 LisboaPortugal
  3. 3.Faculdade de Ciências e Tecnologia, Universidade de Coimbra, Polo II, 3030 CoimbraPortugal

Personalised recommendations