Apply a Rough Set-Based Classifier to Dependency Parsing

  • Yangsheng Ji
  • Lin Shang
  • Xinyu Dai
  • Ruoce Ma
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5009)


A rough set-based semi-naive Bayesian classification method is applied to dependency parsing, which is an important task in syntactic structure analysis of natural language processing. Many parsing algorithms have emerged combined with statistical machine learning techniques. The rough set-based classifier is embedded with Nivre’s deterministic parsing algorithm to conduct dependency parsing task on a Chinese corpus. Experimental results show that the method has a good performance on dependency parsing task. Moreover, the experiments have justified the effectiveness of the classification influence.


Rough set Attribute dependency Semi-naive Bayesian classifier Dependency parsing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nivre, J., Hall, J., Nilsson, J.: Memory-Based Dependency Parsing. In: Ng, H.T., Riloff, E. (eds.) Proceedings of the Eighth Conference on Computational Natural Language Learning (CoNLL), Boston, Massachusetts, 6-7 May 2004, pp. 49–56 (2004)Google Scholar
  2. 2.
    Yuret, D.: Dependency Parsing as a Classification Problem. In: Proceedings of the Tenth Conference on Computational Natural Language Learning (CoNLL) (2006)Google Scholar
  3. 3.
    Ji, Y.S., Shang, L.: RoughTree A Classifier with Naive-Bayes and Rough Sets Hybrid in Decision Tree Representation. In: 2007 IEEE International Conference on Granular Computing, Silicon, Valley, USA, pp. 221–227 (2007)Google Scholar
  4. 4.
    Kononenko, I.: Comparison of inductive and Naive Bayesian learning approaches to automatic knowledge acquisition. In: Wielinga, B., et al. (eds.) Current Trends in Knowledge Acquisition, IOS Press, Amsterdam (1990)Google Scholar
  5. 5.
    Domingos, P., Pazzani, M.: Beyond independence: Conditions for the optimality of the simple Bayesian classifier. In: Proc. 13th Intl. Conf. on Machine Learning, pp. 105–112. Morgan Kaufmann, San Francisco (1996)Google Scholar
  6. 6.
    Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Machine Learning 29, 131–163 (1997)zbMATHCrossRefGoogle Scholar
  7. 7.
    Zheng, Z., Webb, G.I.: Lazy Learning of Bayesian Rules. Machine Learning 41(1), 53–84 (2000)CrossRefGoogle Scholar
  8. 8.
    Webb, G.I., Boughton, J., Wang, Z.: Not So Naive Bayes: Aggregating One-Dependence Estimators. Machine Learning 58(1), 5–24 (2005)zbMATHCrossRefGoogle Scholar
  9. 9.
    Kohavi, R.: Scaling up the accuracy of naive-Bayes classifiers: A decision-tree hybrid. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, pp. 202–207. The AAAI Press, Menlo Park (1996)Google Scholar
  10. 10.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, Los Altos, California (1993)Google Scholar
  11. 11.
    Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth International Group (1984)Google Scholar
  12. 12.
    Pagallo, G., Haussler, D.: Boolean feature discovery in empirical learning. Machine Learning 5, 71–79 (1990)CrossRefGoogle Scholar
  13. 13.
    Charniak, E.: A Maximum-Entropy-Inspired Parser. In: Proceedings of the Second Meeting of North American Chapter of Association for Computational Linguistics (NAACL 2000), pp. 132–139 (2000)Google Scholar
  14. 14.
    Donald, M.: Spanning Tree Methods for Discriminative Training of Dependency Parsers. In: Proceedings of COLING 2004, Geneva, Switzerland, August 23-27, pp. 105–110 (2004)Google Scholar
  15. 15.
    Yamada, H., Matsumoto, Y.: Statistical dependency analysis with support vector machines. In: Proceedings of IWPT, pp. 195–206 (2003)Google Scholar
  16. 16.
    Nivre, J.: An Efficient Algorithm for Projective Dependency Parsing. In: Proceedings of the 8th International Workshop on Parsing Technologies (IWPT 2003), Nancy, France, April 23-25, pp. 149–160 (2003)Google Scholar
  17. 17.
    Nakagawa, T., Kudoh, T., Matsumoto, Y.: Revision learning and its application to part-of-speech tagging. In: Proceedings of Association for Computational Linguistics, pp. 497–504 (2002)Google Scholar
  18. 18.
    Pawlak, Z.: Rough Sets. International Journal of Information and Computer Sciences 11(5), 341–356 (1982)CrossRefMathSciNetGoogle Scholar
  19. 19.
    Pawlak, Z.: Rough Sets: Theoretical aspects of reasoning about data. Kluwer Academic Publishers, Dordrecht, Netherlands (1991)zbMATHGoogle Scholar
  20. 20.
    Duan, X.Y., Zhao, J., Xu, B.: Chinese Dependency Parsing Based on Action Modeling. In: 9th Chinese National Conference on Computational Linguistics, Dalian, China, August 6-8, pp. 133–139 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Yangsheng Ji
    • 1
  • Lin Shang
    • 1
  • Xinyu Dai
    • 1
  • Ruoce Ma
    • 1
  1. 1.State Key Laboratory for Novel Software TechnologyNanjing UniversityChina

Personalised recommendations