Module-level testing for natural language understanding
- 26 Downloads
We have examined a module-level evaluation methodology for natural language understanding, illustrating insights gained during implementation. It is possible to produce useful quantitative and qualitative results using such a methodology, provided certain pitfalls are avoided.
KeywordsArtificial Intelligence Natural Language Qualitative Result Computational Linguistic Evaluation Methodology
Unable to display preview. Download preview PDF.
- Flank, Sharon, Aaron Temin, Hatte Blejer, Andrew Kehler, and Sherman Greenstein Module-Level Testing: Lessons Learned. Presented at the Workshop on Evaluation of Natural Language Processing Systems, at the Association for Computational Linguistics Annual Meeting, Berkeley, CA, 18 June 1991. (Rome Laboratory Technical Report)Google Scholar
- Greenstein, Sherman and Hatte Blejer (1990) A Test and Evaluation Plan for Natural Language Understanding. SRA Working Paper.Google Scholar
- Palmer, Martha and Tim Finin (1990) Workshop on the Evaluation of Natural Language Processing Systems.Computational Linguistics 16(3): 175–181.Google Scholar
- Sundheim, Beth M. (1989) Plans for a Task-Oriented Evaluation of Natural Language Understanding Systems.Proceedings of the DARPA Speech and Natural Language Workshop: 197–202.Google Scholar