BBS Based Hot Topic Retrieval Using Back-Propagation Neural Network
BBS, often referred to as forum, is a system that offers so much information, where people talk about various topics. Some topics are hot while others are unpopular. It’s rather a hard job for a person to find out hot topics in these tons of information. In this paper we introduce a system that automatically retrieves hot topics on BBS. Unlike some topic detection systems, this system not only discovers topics but also judges their hotness. Messages are first clustered into topics based on their lexical similarity. Then a BPNN (Back-Propagation Neural Network) based classification algorithm is used to judge the hotness of topic according to its popularity, its quality as well as its message distribution over time. We have conducted experiments over Yahoo! Message Board (Yahoo BBS) and retrieved satisfactory results.
KeywordsCluster Centroid Reply Message Message Board Average Authority Lexical Similarity
Unable to display preview. Download preview PDF.
- 1.TDT. The 2003 topic detectionand tracking (TDT2003) task definition and evaluation (June 2003), http://www.nist.gov/speech/tests/tdt/tdt2003/index.htm
- 2.Walls, F., Jin, H., Sista, S., Schwartz, R.: Topic Detection in Broadcast News (1999)Google Scholar
- 3.Bun, K.K., Ishizuka, M.: Topic Extraction from News Archive Using TF*PDF Algorithm. In: Proceedings of the 3rd International Conference on Web Information Systems Engineering (2002)Google Scholar
- 4.Papka, R., Allan, J., Lavrenko, V.: UMASS Approaches to Detection and Tracking at TDT2 (1999)Google Scholar
- 5.Yang, Y., Pierce, T., Carbonell, J.: A Study on Retrospective and On-Line Event Detection. In: Proceedings of SIGIR 1998, 21st ACM International Conference on Research and Development in Information Retrieval (1998)Google Scholar