Improvement and Application of TF * IDF Algorithm
The traditional TF-IDF probability model is a relatively simple formula. For a few words which are commonly used and not stop words in a paper,it is lack of better differentiate and is not suitable for many specific cases, such as news advertising service module, about extraction of key words of the article, according to the deficiencies and the demand of news advertising service module, on the basis of the original algorithm, presents a new probability model——MTF-IDF, it greatly improves the accuracy of news information data retrieval.
KeywordsTF * IDF MI MTF-IDF
Unable to display preview. Download preview PDF.
- 1.Shi, C.-y., Xu, C.-j., Yang, X.-j.: Documents cluster summary. Chinese Information Journal, 106–109 (2006)Google Scholar
- 2.Wei, J., Chang, C.-w.: Sub-dictionary of single array and full map. Computer Engineering and Applications, 184–186 (2007)Google Scholar
- 3.Zhai, W.-b., Zhou, Z.-l., Jiang, Z.-m., et al.: Design of Chinese Word Dictionary. Computer Engineering and Applications, 1–2 (2007)Google Scholar
- 4.Lin, Y.-m., Lu, Z.-y., Zhao, S., Zhu, W.-d.: Analysis and Improvement of Text Feature weighted method TFIDF. Computer Engineering and Design, 2923–2926 (2008)Google Scholar
- 5.Gao, X.-d., Wu, L.-y.: Chinese keywords extraction algorithm Based on high dimensional clustering technique. China Management Information, 9–12 (2011)Google Scholar
- 6.Li, P.: Text classification research Based on the improved the weights of the words. Northeast Normal University, 251–255 (2010)Google Scholar
- 7.Zhou, Y.-b., Chen, X.-s., Wang, W.-x.: The topic crawler research based on Bayes classifier. Computer Application Research, 33–35 (2009)Google Scholar
- 8.Zhang, X.-y., Wu, X.-q., Zhang, P.-y.: Study of garbage filter method in Agriculture website page. Network Security Technology and Application, 102–105 (2011)Google Scholar
- 9.Shi, C.-y., Xu, C.-j., Yang, X.-j.: TFIDF in algorithm. Computer Application, 321–324 (2009)Google Scholar
- 10.Xu, Z.-y.: Analysis and Improvement of Feature selection method in Text classification. Computer and Modernization, 28–30 (2010)Google Scholar
- 11.Sun, Q.-h.: Key extraction method based on spatial distribution and information entropy. Dalian University of Technology, 77–79 (2010)Google Scholar