Advertisement

Language Resources and Evaluation

, Volume 40, Issue 3–4, pp 291–309 | Cite as

A lexicon for Vietnamese language processing

  • Thị Minh Huyền Nguyễn
  • Laurent Romary
  • Mathias Rossignol
  • Xuân Lương Vũ
Article

Abstract

Only very recently have Vietnamese researchers begun to be involved in the domain of Natural Language Processing (NLP). As there does not exist any published work in formal linguistics nor any recognizable standard for Vietnamese word definition and word categories, the fundamental tasks for automatic Vietnamese language processing, such as part-of-speech tagging, parsing, etc., are very difficult tasks for computer scientists. The fact that all necessary linguistic resources have to be built from scratch by each research team is a real obstacle to the development of Vietnamese language processing. The aim of our projects is thus to build a common linguistic database that is freely and easily exploitable for the automatic processing of Vietnamese. In this paper, we present our work on creating a Vietnamese lexicon for NLP applications. We emphasize the standardization aspect of the lexicon representation. We especially propose an extensible set of Vietnamese syntactic descriptions that can be used for tagset definition and morphosyntactic analysis. These descriptors are established in such a way as to be a reference set proposal for Vietnamese in the context of ISO subcommittee TC 37/SC 4 (Language Resource Management).

Keywords

Lexicon Linguistic resources Part-of-speech Standardization Syntactic description Vietnamese 

Notes

Acknowledgements

This work would not have been possible without the enthusiastic collaboration of all the linguists at the Vietnam Lexicography Centre, especially Hoàng Thị Tuyền Linh, Ðặng Thanh Hoà, Ðào Minh Thu and Phạm Thị Thuỷ. Great thanks to them! Many thanks also to Nguyễn Thành Bôn for his contribution to the development of the various tools.

References

  1. Cao, X. H. (2000). Tiếng Việt—mấy vấn đề ngữ âm, ngữ nghĩa (Vietnamese—Some Questions on Phonetics, Syntax and Semantics). Hà Nội, Việt Nam: NXB Giào dục.Google Scholar
  2. Dien, D., Hoi, P. P., & Hung, N. Q. (2003). Some lexical issues in electronic Vietnamese dictionary. In PAPILLON-2003 workshop on multilingual lexical databases. Hokaido University, Japan.Google Scholar
  3. Dien, D., & Kiem, H. (2003). POS-tagger for English–Vietnamese bilingual corpus. In Workshop: Building and using parallel texts: Data driven machine translation and beyond. Canada: Edmonton.Google Scholar
  4. Dien, D., & Kiem, H. (2005). State of the art of machine translation in Vietnam. AAMT Journal, special issue on MT Summit X.Google Scholar
  5. Dien, D., Kiem, H., & Toan N. V. (2001). Vietnamese word segmentation. In Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium (NLPRS2001). Tokyo, Japan.Google Scholar
  6. Diệp Q. B., & Văn Thung, H. (1999). Ngữ phàp tiếng Việt (Vietnamese Grammar), (Vol 1). Hà Nội Việt Nam: NXB Giào dục.Google Scholar
  7. Erjavec, T., Ide, N., & Tufis, D. (1998). Development and assessment of common lexical specifications for six central and eastern European languages. In Proceedings of the First International Conference on Language Resources and Evaluation. Granada, Spain.Google Scholar
  8. Hoàng, P. (Ed.) (2002). Từ điển tiếng Việt (Vietnamese Dictionary). Việt Nam: NXB Ðà Nẵng.Google Scholar
  9. Hữu Ð., Dõi, T. T., & Lan. Ð. T. (1998). Cơ sở tiếng Việt (Basis of Vietnamese). Hà Nội Việt Nam: NXB Giào dục.Google Scholar
  10. Ide, N., & Romary, L. (2001). Standards for language resources. In: Proceedings of the IRCS Workshop on Linguistic Databases. Philadelphia, US.Google Scholar
  11. Ide, N., & Romary, L. (2003). Encoding syntactic annotation. In A. Abeillè (Ed.), Building and using parsed corpora. Dordrecht, Netherlands: Kluwer Academic Publishers.Google Scholar
  12. Ide, N., & Véronis, J. (1994). MULTEXT: Multilingual text tools and corpora. In: Proceedings of the 15th International Conference on Computational Linguistics (COLING 94). Kyoto, Japan.Google Scholar
  13. Ide, N., & Véronis, J. (1995). Encoding dictionaries. In N. Ide & J. Véronis (Eds.), Text encoding initiative: Background and context. Dordrecht, Netherlands: Kluwer Academic Publishers.Google Scholar
  14. ISO 24613, Rev.13 (2006). Language resource management—Lexical markup framework (LMF). ISO, Geneva, Switzerland.Google Scholar
  15. Li, C. N., & Thompson, S. A. (1976). Subject and topic: A new typology of language. In C. N. Li (Ed.), Subject and topic (pp. 457–489). London/New York: Academic Press.Google Scholar
  16. Nguyen, T. M. H., Romary, L., & Vu X. L. (2003). Une étude de cas pour l’étiquetage morpho-syntaxique de textes Vietnamiens. In: Actes de la Conférence francophone internationale sur le Traitement Automatique des Langues Naturelles (TALN 03). Batz-sur-mer, France.Google Scholar
  17. Nguyễn, T. M. H. (2006). Outils et ressources linguistiques pour l’alignement de textes multilingues Français-Vietnamiens. Thèse de doctorat en informatique, Université Henri Poincaré, Nancy I, Nancy, France.Google Scholar
  18. Nguyễn, T. C. (1998). Ngữ pháp tiếng Việt (Vietnamese Grammar). Hà Nội, Việt Nam: NXB Ðại học Quốc gia.Google Scholar
  19. Romary, L., Salmon-Alt, S., & Francopoulo, G. (2004). Standards going concrete: From LMF to Morphalou. In Workshop Enhancing and using electronic dictionaries. The 20th International Conference on Computational Linguistics (COLING). Geneva, Switzerland.Google Scholar
  20. Uỷ ban Khoa học Xã hội Việt Nam (1983). Ngữ pháp tiếng Việt (Vietnamese Grammar). Hà Nội, Việt Nam: NXB Khoa học Xã hội.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2007

Authors and Affiliations

  • Thị Minh Huyền Nguyễn
    • 1
  • Laurent Romary
    • 2
  • Mathias Rossignol
    • 3
  • Xuân Lương Vũ
    • 4
  1. 1.Faculty of Mathematics, Mechanics and InformaticsHanoi University of ScienceHanoiVietnam
  2. 2.LORIANancyFrance
  3. 3.International Research Center MICAHanoiVietnam
  4. 4.Vietnam Lexicography CenterHanoiVietnam

Personalised recommendations