Abstract
Sense tagged corpus plays a very crucial role to Natural Language Processing, especially on the research of word sense disambiguation and natural language understanding. Having a large-scale Chinese sense tagged corpus seems to be very essential, but in fact, such large-scale corpus is the critical deficiency at the current stage. This paper is aimed to design a large-scale Chinese full text sense tagged Corpus, which contains over 110,000 words. The Academia Sinica Balanced Corpus of Modern Chinese (also named Sinica Corpus) is treated as the tagging object, and there are 56 full texts extracted from this corpus. By using the N-gram statistics and the information of collocation, the preparation work for automatic sense tagging is planned by combining the techniques and methods of machine learning and the probability model. In order to achieve a highly precise result, the result of automatic sense tagging needs the touch of manual revising.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chen, K.-j., et al.: Sinica Corpus: Design Methodology for Balanced Corpora. In: Park, B.-S., Kim, J.B. (eds.) Proceeding of the 11 th Pacific Asia Conference on Language, Information and Computation, pp. 167–176. Kyung Hee University, Seoul (1996)
Ma, W.-Y., Huang, C.-R.: Uniform and Effective Tagging of a Heterogeneous Giga-word Corpus. In: Presented at the 5th International Conference on Language Resources and Evaluation (LREC2006). Genoa, Italy, May 2006, pp. 24–28 (2006)
Senseval, http://www.senseval.org/
Huang, C.-R. (ed.): Meaning and Sense. Technical Report 06-03, Chinese Wordnet Group, Academia Sinica, Taiwan (in Chinese) (2006)
Huang, C.-R., et al.: The Sinica Sense Management System: Design and Implementation. Computational Linguistics and Chinese Language Processing 10(4), 417–430 (2005)
Ker, S.-J., Huang, C.-R., Chen, J.-N.: A Preliminary Study of Large-scale Corpus Sense Tagging. In: The 5th Lexical Semantics Workshop, Beijing (in Chinese) (2004)
Ker, S.-J., Chen, J.-N.: Large-scale Sense Tagging by Combining Machine Learning and Linguistic Knowledge. In: The 8th Lexical Semantics Workshop, Hong Kong (in Chinese) (2007)
Yarowsky: One Sense Per Collocation. In: Proceedings of ARPA Human Language Technology Workshop, Princeton (1993)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ker, Sj. et al. (2008). Design and Prototype of a Large-Scale and Fully Sense-Tagged Corpus. In: Tokunaga, T., Ortega, A. (eds) Large-Scale Knowledge Resources. Construction and Application. LKR 2008. Lecture Notes in Computer Science(), vol 4938. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78159-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-78159-2_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78158-5
Online ISBN: 978-3-540-78159-2
eBook Packages: Computer ScienceComputer Science (R0)