A Practical Approach to Testing a Natural Language System: Tools and Procedures



Most software development projects follow some type of clearly defined process, refined over many years of practical experience. Different phases of development are carefully tracked and documented according to strict guidelines. Until now the majority of natural language systems have been developed as research projects, that is they have been developed without such rigid conditions. However, now that the market for natural language systems is beginning to open up, there is a growing number of commercially available products. It therefore seems timely to start to discuss how the more traditional approaches to software development can be applied to such technologies. This paper concentrates on one vital stage in any development process, namely the test phase. We will show how current approaches need to be adapted to suit the needs of this type of software and, conversely, how much can be gained by looking at the experiences of testers of more conventional software systems.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Aron, J. D. (1983): The program development process: Part II The programming team, Addison-Wesley Publishing Company.Google Scholar
  2. [2]
    Griesmer, James H. (1990): “Validating and testing the FAME expert system” in The proceedings of the ITL conference on expert systems Yorktown Heights, N. Y.Google Scholar
  3. [3]
    Horgan, Joseph R. and Aditya P. Mathur (1992): “Assessing testing tools in research and education” in IEEE Software May 1992.Google Scholar
  4. [4]
    Malhotra, Ashok (1975): “Knowledge-based English language systems for management support: an analysis of requirements” in ITCAI-4.Google Scholar
  5. [5]
    Musa, John D. (1989): “Tools for measuring software reliability” in IEEE Spectrum February 1989.Google Scholar
  6. [6]
    Myers, Glenford J. (1979): The Art of Software Testing John Wiley and Sons Ltd, N.Y.Google Scholar
  7. [7]
    Pfleeger, Shari Lawrence (1992): “Measuring software reliability” in IEEE Spectrum August 1992.Google Scholar
  8. [8]
    Sanamrad, Mohammad A. and Ivan Bretan (1992): “IBM SAA Language Access: A largescale commercial product implemented in PROLOG” in Proceedings of the 1st international conference on practical applications of PROLOG, London, April 1992.Google Scholar
  9. [9]
    Walker, Marilyn A., Andrew L. Nelson, Phil Stenton (1992): “A case study of natural language customisation: The practical effects of world knowledge” in The proceedings of the 15th International Conference on Computational Linguistics, Nantes, August 1992.Google Scholar
  10. [10]
    Whitten, Neal (1989): Managing software development projects: formula for success, John Wiley and Sons Ltd, N.Y.Google Scholar
  11. [11]
    Zoeppritz, Magdalena (1985): “Computer Talk?” Heidelberg Scientific Center TN 85.05.Google Scholar
  12. [12]
    Zoeppritz, Magdalena (1986): “Investigating human factors in natural language data base query” in Jacob L. Mey. Language and discourse: Test and protest. A Festschrift for Petr Sgall John Benjamins publishing Co., Amsterdam/Philadelphia.Google Scholar
  13. [13]
    Zoeppritz, Magdalena (1992): “Software ergonomics of natural language systems” (this volume)Google Scholar

Copyright information

© Friedr. Vieweg & Sohn Verlagsgesellschaft mbH, Braunschweig/Wiesbaden 1995

Authors and Affiliations

  1. 1.Natural Language Processing DepartmentIBM Nordic LaboratoriesLidingöSweden

Personalised recommendations