Abstract
Chinese abbreviations are frequently used without being defined, which has brought much difficulty into NLP. In this study, the definition-independent abbreviation identification problem is proposed and resolved as a classification task in which abbreviation candidates are classified as either ‘abbreviation’ or ‘non-abbreviation’ according to the posterior probability. To meet our aim of identifying new abbreviations from existing ones, our solution is to add generalization capability to the abbreviation lexicon by replacing words with word classes and therefore create abbreviation-templates. By utilizing abbreviation-template features as well as context information, a SVM model is employed as the classifier. The evaluation on a raw Chinese corpus obtains an encouraging performance. Our experiments further demonstrate the improvement after integrating with morphological analysis, substring analysis and person name identification.
Supported by National Social Science Foundation of China (No. 05BYY043) and National Natural Science Foundation of China (No. 60473138, No. 60675035).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chang, J., Schütze, H., Altman, R.: Creating an online dictionary of abbreviations from MEDLINE. Journal of American Medical Information Association 9(6), 612–620 (2002)
Gao, J., Li, M., Huang, C.: Improved Source-channel Models for Chinese Word Segmentation. In: Proceedings of the 41st Annual Meeting of Association for Computational Linguistics (ACL), Sapporo, Japan, July 8-10, pp. 272–279 (2003)
Chang, J.-S., Lai, Y.-T.: A Preliminary Study on Probabilistic Models for Chinese Abbreviations. In: Proceedings of the Third SIGHAN Workshop on Chinese Language Learning, ACL, Barcelona, Spain, pp. 9–16 (2004)
Sun, J., Gao, J., Zhang, L., Zhou, M., Huang, C.-N.: Chinese Named Entity Identification Using Class-based Language Model. In: Proc. of the 19th International Conference on Computational Linguistics, Taipei, pp. 967–973 (2002)
Katz, S.M.: Estimation of Probabilities from Sparse Data for the Language Model Component of a Speech Recognizer. IEEE ASSP 35(3), 400–401 (1987)
Och, Franz Josef: An efficient method for determining bilingual word classes. In: EACL 1999: Ninth Conference of the European Chapter of the Association for Computational Linguistics, pp. 71–76 (1999)
Sproat, R., Shih, C., Gale, W., Chang, N.: A Stochastic Finite-State Word-Segmentation Algorithm for Chinese. Computational Linguistics 22(3), 377–404 (1996)
Sproat, R., Shih, C.: Corpus-Based Methods in Chinese Morphology and Phonology. In: COLING 2002 (2002)
Schwartz, A., Hearst, M.: A simple algorithm for identifying abbreviation definitions in biomedical texts. In: Pacific Symposium on Biocomputing (PSB 2003), Kauai, Hawaii (2003)
Martin, S., Liermann, J., Ney, H.: Algorithms for Bigram and Trigram Word Clustering. Speech Communication 24(1), 19–37 (1998)
Taghva, K., Gilbreth, J.: Recognizing acronyms and their definitions. International journal on Document Analysis and Recognition, 191–198 (1999)
Joachims, T.: Making large-Scale SVM Learning Practical. In: Schkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods - Support Vector Learning. MIT Press, Cambridge (1999)
Yeates, S.: Automatic extraction of acronyms from text. In: Third New Zealand Computer Science Research Students’ Conference, pp. 117–124 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, X., Wang, H. (2006). Chinese Abbreviation Identification Using Abbreviation-Template Features and Context Information. In: Matsumoto, Y., Sproat, R.W., Wong, KF., Zhang, M. (eds) Computer Processing of Oriental Languages. Beyond the Orient: The Research Challenges Ahead. ICCPOL 2006. Lecture Notes in Computer Science(), vol 4285. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11940098_26
Download citation
DOI: https://doi.org/10.1007/11940098_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49667-0
Online ISBN: 978-3-540-49668-7
eBook Packages: Computer ScienceComputer Science (R0)