Advertisement

Improvement and Application of TF * IDF Algorithm

  • Ji-Rui Li
  • Yan-Fang Mao
  • Kai Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7030)

Abstract

The traditional TF-IDF probability model is a relatively simple formula. For a few words which are commonly used and not stop words in a paper,it is lack of better differentiate and is not suitable for many specific cases, such as news advertising service module, about extraction of key words of the article, according to the deficiencies and the demand of news advertising service module, on the basis of the original algorithm, presents a new probability model——MTF-IDF, it greatly improves the accuracy of news information data retrieval.

Keywords

TF * IDF MI MTF-IDF 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Shi, C.-y., Xu, C.-j., Yang, X.-j.: Documents cluster summary. Chinese Information Journal, 106–109 (2006)Google Scholar
  2. 2.
    Wei, J., Chang, C.-w.: Sub-dictionary of single array and full map. Computer Engineering and Applications, 184–186 (2007)Google Scholar
  3. 3.
    Zhai, W.-b., Zhou, Z.-l., Jiang, Z.-m., et al.: Design of Chinese Word Dictionary. Computer Engineering and Applications, 1–2 (2007)Google Scholar
  4. 4.
    Lin, Y.-m., Lu, Z.-y., Zhao, S., Zhu, W.-d.: Analysis and Improvement of Text Feature weighted method TFIDF. Computer Engineering and Design, 2923–2926 (2008)Google Scholar
  5. 5.
    Gao, X.-d., Wu, L.-y.: Chinese keywords extraction algorithm Based on high dimensional clustering technique. China Management Information, 9–12 (2011)Google Scholar
  6. 6.
    Li, P.: Text classification research Based on the improved the weights of the words. Northeast Normal University, 251–255 (2010)Google Scholar
  7. 7.
    Zhou, Y.-b., Chen, X.-s., Wang, W.-x.: The topic crawler research based on Bayes classifier. Computer Application Research, 33–35 (2009)Google Scholar
  8. 8.
    Zhang, X.-y., Wu, X.-q., Zhang, P.-y.: Study of garbage filter method in Agriculture website page. Network Security Technology and Application, 102–105 (2011)Google Scholar
  9. 9.
    Shi, C.-y., Xu, C.-j., Yang, X.-j.: TFIDF in algorithm. Computer Application, 321–324 (2009)Google Scholar
  10. 10.
    Xu, Z.-y.: Analysis and Improvement of Feature selection method in Text classification. Computer and Modernization, 28–30 (2010)Google Scholar
  11. 11.
    Sun, Q.-h.: Key extraction method based on spatial distribution and information entropy. Dalian University of Technology, 77–79 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ji-Rui Li
    • 1
  • Yan-Fang Mao
    • 2
  • Kai Yang
    • 3
  1. 1.Information Engineer DepartmentHenan Vocational and Technical InstituteZhengzhouChina
  2. 2.School of Computer and Communication EngineeringZhengzhou University of Light IndustryZhengzhouChina
  3. 3.Computer DepartmentArmed Police Command College in ZhengzhouZhengzhouChina

Personalised recommendations