Advertisement

On the Feasibility of Automatic Topic Detection in IM Chats

Conference paper
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 150)

Abstract

This paper presents an initial exploration into the feasibility of automatic topic detection in instant messaging applications. We have developed a prototype system that employs a set of preprocessing techniques, weighted scheme for word combination and suitable word classification and extraction of non-relevant words. The topic detection is based on the descriptive metadata for the selected keywords provided by an existing public knowledge base. In addition, the selected keywords have been linked with popular tweets to provide supplemental information. An exploratory user study has been conducted to gather some insights into the performance and usability metrics related to the proposed approach.

Keywords

Real-time topic detection preprocessing techniques IM chat message characteristics 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bengel, J., Gauch, S., Mittur, E., Vijayaraghavan, R.: Chattrack - Chat room topic detection using classification. In: 2nd Symposium on Intelligence and Security Informatics, Tucson, Arizona (2004)Google Scholar
  2. 2.
    Hansen, L.K., Larsen, J., Kolenda, T.: Blind Detection of Independent Dynamic Components. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. 3197–3200 (2001)Google Scholar
  3. 3.
    Ozyurt, O., Kose, K.: Chat Mining: Automatically Determination of Chat Conversations Topic in text based chat mediums. Journal on Selected Areas in Expert Systems with Applications ESWA 4843 (2010)Google Scholar
  4. 4.
    Seymore, K., Rosenfeld, R.: Using Story Topics for Language Model Adaptation. In: Eurospeech 1997 (1997)Google Scholar
  5. 5.
    Dong, H., Hui, S.C., He, Y.: Structural analysis of chat messages for topic detection. Online Information Review 30(5), 496–516 (2006)CrossRefGoogle Scholar
  6. 6.
    Zhang, J., Yang, Y., Carbonell, J.: New Event Detection with Nearest Neighbor, Support Vector Machines, and Kernel Regression. CMU Technical Report CMU-CS-04-118, CMU-LTI-04-180 (2004)Google Scholar
  7. 7.
    Freebase, repository of structured data (accessed March 20, 2011), http://www.freebase.com
  8. 8.
    WordNet®, a lexical database for English, http://wordnet.princeton.edu. (accessed August 10, 2011)Google Scholar
  9. 9.
    Masaitene, D.: Analyzing Casual Conversations. Respectus Philogicus 1(16) (2001)Google Scholar
  10. 10.
    Navarro, G.: A guided tour to approximate string matching. ACM Computing Surveys 33(1), 31–88 (2001)CrossRefGoogle Scholar
  11. 11.
    Apte, C., Damerau, F., Weiss, S.: Automated learning of decision rules for text categorization. ACM Transactions on Information Systems (1994)Google Scholar
  12. 12.
    Twitter, an online social networking and microblogging service, http://twitter.com/ (accessed August 15, 2011)
  13. 13.
    Apte, C., Damerau, F., Weiss, S.: Text mining with decision rules and decision trees. In: Conference on Automated Learning and Discovery, Workshop 6: Learning from Text and the Web (1998)Google Scholar
  14. 14.
    TweetSharp,NET library for micro-blogging platform, http://tweetsharp.codeplex.com (accessed March 20, 2011)
  15. 15.
    Jiang, J., Conrath, D.: Semantic similarity based on corpus statistics and lexical taxonomy. In: International Conference on Research in Computational Linguistics, pp. 19–33 (1997)Google Scholar

Copyright information

© Springer-Verlag GmbH Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.InterWorksBitolaMacedonia
  2. 2.Faculty of Computer Sciences and EngineeringSs. Cyril and Methodius UniversitySkopjeMacedonia

Personalised recommendations