Abstract
This paper examines how formal specification techniques can support the verification and validation (VandV) of knowledge-based systems. Formal specification techniques provide levels of description which support both verification and validation, and VandV techniques feed back to assist the development of the specifications. Developing a formal specification for a system requires the prior construction of a conceptual model for the intended system. Many elements of this conceptual model can be effectively used to support VandV. Using these elements, the VandV process becomes deeper and more elaborate and it produces results of a better quality compared with the VandV activities which can be performed on systems developed without conceptual models. However, we note that there are concerns in using formal specification techniques for VandV, not least being the effort involved in creating the specifications.
Chapter PDF
Similar content being viewed by others
Keywords
References
Batarekh, A., Preece, A.D., Bennett, A. and Grogono, P. (1991) Specifying an expert system. Expert Systems with Applications, 2, 285 - 303.
Bellman, K.. (1990) The modeling issues inherent in testing and evaluating knowledge-based systems. Expert Systems with Applications, 1, 199 - 215.
Buchanan, B. and Shortliffe, E. (1984) The problem of evaluation, in Rule-Based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project, 571 - 588, Addison-Wesley, Reading MA.
Chandrasekaran, B. (1983) On evaluating AI systems for medical diagnosis. AI Magazine, 4, 3437.
Fensel, D. and van Harmelen, F. (1994) A comparison of languages which operationalise and formalise KADS models of expertise. Knowledge Engineering Review, 9, 105 - 146.
Ginsberg, A. (1988) Knowledge-base reduction: A new approach to checking knowledge bases for inconsistency and redundancy, in Proc. 7th National Conference on Artificial Intelligence (AAAI88), vol. 2, 585 - 589.
Haugh, J. (1988) The application of formal specification techniques to knowledge-based system development, in UK IT 88 Conference Publication, 95 - 98, Information Engineering Directorate, London.
Laurent, J-P. (1992) Proposals for a valid terminology in KBS validation, in Proc. 10th European Conference on Artificial Intelligence (ECAI 92), 829 - 834, John Wiley and Sons, Chichester.
Miller, L.A. (1990) Dynamic testing of knowledge bases using the heuristic testing approach. Expert Systems with Applications, 1 (3): 249 - 269, 1990.
O'Keefe, R.M., Balci, O., and Smith E.P. (1987) Validating expert system performance. IEEE Expert, 2, 81 - 90.
Plant, R.T. and Gold, D. (1990) Increasing expert system reliability through the use of a formal specification, in AAAI-90 Workshop on Knowledge Based Systems Verification, Validation and Testing, AAAI, Menlo Park, CA.
Preece, A.D. (1990) Towards a methodology for evaluating expert systems. Expert Systems, 7, 215 - 223.
Preece, A., Shinghal, R., and Batarekh, A. (1992) Principles and practice in verifying rule-based systems. Knowledge Engineering Review, 7, 115 - 141.
Suwa, M., Scott, A. and Shortliffe, E. (1982) An approach to verifying completeness and consistency in a rule-based expert system. AI Magazine, 3, 16 - 21.
Turing, A. (1950) Computing machinery and intelligence. Mind, 59, 236 - 248.
Wielinga, B., Schreiber, A. and Breuker, J. (1992) KADS: a modelling approach to knowledge engineering. Knowledge Acquisition, 4, 5 - 54.
Zualkernan, I., Tsai, W-T. and Kirani, S. (1992) Testing expert systems using conventional techniques, in Proc. 16th Annual Computer Software and Applications Conference, 320-325.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Meseguer, P., Preece, A.D. (1996). Assessing the Role of Formal Specifications in Verification and Validation of Knowledge‑Based Systems. In: Bologna, S., Bucci, G. (eds) Achieving Quality in Software. IFIP — The International Federation for Information Processing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-34869-8_26
Download citation
DOI: https://doi.org/10.1007/978-0-387-34869-8_26
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-4392-0
Online ISBN: 978-0-387-34869-8
eBook Packages: Springer Book Archive