Conclusion
We have examined a module-level evaluation methodology for natural language understanding, illustrating insights gained during implementation. It is possible to produce useful quantitative and qualitative results using such a methodology, provided certain pitfalls are avoided.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Flank, Sharon, Aaron Temin, Hatte Blejer, Andrew Kehler, and Sherman Greenstein Module-Level Testing: Lessons Learned. Presented at the Workshop on Evaluation of Natural Language Processing Systems, at the Association for Computational Linguistics Annual Meeting, Berkeley, CA, 18 June 1991. (Rome Laboratory Technical Report)
Greenstein, Sherman and Hatte Blejer (1990) A Test and Evaluation Plan for Natural Language Understanding. SRA Working Paper.
Palmer, Martha and Tim Finin (1990) Workshop on the Evaluation of Natural Language Processing Systems.Computational Linguistics 16(3): 175–181.
Sundheim, Beth M. (1989) Plans for a Task-Oriented Evaluation of Natural Language Understanding Systems.Proceedings of the DARPA Speech and Natural Language Workshop: 197–202.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Flank, S., Temin, A., Blejer, H. et al. Module-level testing for natural language understanding. Mach Translat 8, 39–47 (1993). https://doi.org/10.1007/BF00981241
Issue Date:
DOI: https://doi.org/10.1007/BF00981241