Tagging Complex NEs with MaxEnt Models: Layered Structures Versus Extended Tagset

  • Deyi Xiong
  • Hongkui Yu
  • Qun Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3248)


The paper discusses two policies for recognizing NEs with complex structures by maximum entropy models. One policy is to develop cascaded MaxEnt models at different levels. The other is to design more detailed tags with human knowledge in order to represent complex structures. The experiments on Chinese organization names recognition indicate that layered structures result in more accurate models while extended tags can not lead to positive results as expected. We empirically prove that the {start, continue, end, unique, other} tag set is the best tag set for NE recognition with MaxEnt models.


Cascade Model MaxEnt Model Multilevel Structure Maximum Entropy Model Context Window 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Berger, A., Pietra, S.D., Pietra, V.D.: A maximum entropy approach to natural language processing. Computational linguistics 22(1), 39–71 (1996)Google Scholar
  2. 2.
    Ratnaparkhi, A.: A maximum entropy part-of-speech tagger. In: Proceedings of the EMNLP Conference, Philadelphia, PA, pp. 133–142 (1998)Google Scholar
  3. 3.
    Borthwick, A.: A Maximum Entropy Approach to Named Entity Recognition. Ph.D. thesis, Computer Science Department, New York University (1999)Google Scholar
  4. 4.
    Darroch, J.N., Ratcliff, D.: Generalized iterative scaling for log-linear models. The Annals of Mathematical Statistics 43(5), 1470–1480 (1972)zbMATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    Bikel, D.M., Schwartz, R., Weischedel, R.M.: An algorithm that learns what’s in a name. Machine Learning 34(1/2/3), 211–231 (1999)zbMATHCrossRefGoogle Scholar
  6. 6.
    Fine, S., Singer, Y., Tishby, N.: The hierarchical hidden Markov model: Analysis and applications. Machine learning 32, 41–62 (1998)zbMATHCrossRefGoogle Scholar
  7. 7.
    Pietra, S.D., Pietra, V.D., Lafferty, J.: Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 380–393 (1997)CrossRefGoogle Scholar
  8. 8.
    Hong-Kui, Y., Hua-Ping, Z., Qun, L.: Recognition of Chinese Organization Name Based on Role Tagging. In: Proceedings of 20th International Conference on Computer Processing of Oriental Languages, ShenYang, pp. 79–87 (2003)Google Scholar
  9. 9.
    Shihong, Y., Shuanhu, B., Paul, W.: Description of the Kent Ridge Digital Labs System Used for MUC-7. In: Proceedings of the MUC-7 (1998)Google Scholar
  10. 10.
    Abney, S.: Partial Parsing via Finite-state Cascades. In: Proceedings of the ESSLLI 1996 Robust Parsing Workshop (1996)Google Scholar
  11. 11.
    Brants, T.: Cascaded Markov Models. In: Proceedings of 9th Conference of the European Chapter of the Association for Computational Linguistics EACL 1999, Bergen, Norway (1999)Google Scholar
  12. 12.
    Gao, J., Li, M., Huang, C.-N.: Improved source-channel models for Chinese word segmentation. In: ACL 2003, Sapporo, Japan, July 7-12, pp. 7–12 (2003)Google Scholar
  13. 13.
    Klein, D., Manning, C.D.: Accurate Unlexicalized Parsing. In: ACL 2003, pp. 423–430 (2003)Google Scholar
  14. 14.
    Skounakis, M., Craven, M., Ray, S.: Hierarchical Hidden Markov Models for Information Extraction. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence, Acapulco, Mexico, Morgan Kaufmann, San Francisco (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Deyi Xiong
    • 1
    • 2
  • Hongkui Yu
    • 1
    • 4
  • Qun Liu
    • 1
    • 3
  1. 1.Institute of Computing Technologythe Chinese Academy of SciencesBeijing
  2. 2.Graduate School of the Chinese Academy of Sciences 
  3. 3.Inst. of Computational LinguisticsPeking UniversityBeijing
  4. 4.Information science & technology collegeBeijing University of Chemical TechnologyBeijing

Personalised recommendations