Sociopedia: An Interactive System for Event Detection and Trend Analysis for Twitter Data

  • R. Kaushik
  • S. Apoorva Chandra
  • Dilip Mallya
  • J. N. V. K. Chaitanya
  • S. Sowmya Kamath
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 44)


The emergence of social media has resulted in the generation of highly versatile and high volume data. Most web search engines return a set of links or web documents as a result of a query, without any interpretation of the results to identify relations in a social sense. In the work presented in this paper, we attempt to create a search engine for social media datastreams, that can interpret inherent relations within tweets, using an ontology built from the tweet dataset itself. The main aim is to analyze evolving social media trends and providing analytics regarding certain real world events, that being new product launches, in our case. Once the tweet dataset is pre-processed to extract relevant entities, Wiki data about these entities is also extracted. It is semantically parsed to retrieve relations between the entities and their properties. Further, we perform various experiments for event detection and trend analysis in terms of representative tweets, key entities and tweet volume, that also provide additional insight into the domain.


Social media analysis Ontology NLP Semantics Knowledge discovery 


  1. 1.
    Asur, S., et al.: Predicting the future with social media. In: 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), vol. 1 (2010)Google Scholar
  2. 2.
    Ritter, A., et al.: Unsupervised modeling of twitter conversations (2010)Google Scholar
  3. 3.
    Mika, P.: Flink: semantic web technology for the extraction and analysis of social networks. Web Semantics: Sci. Services Agents World Wide Web 3(2), 211–223 (2005)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Iwanaga, I., et al.: Building an earthquake evacuation ontology from twitter. In: 2011 IEEE International Conference on Granular Computing (GrC) (2011)Google Scholar
  5. 5.
    Celik, I., et al.: Learning semantic relationships between entities in twitter. In: Web Engineering, pp. 167–181. Springer (2011)Google Scholar
  6. 6.
    Ozdikis, O., et al.: Semantic expansion of hashtags for enhanced event detection in twitter. In: 1st International Workshop on Online Social Systems (2012)Google Scholar
  7. 7.
    Owoputi, O., et al.: Improved part-of-speech tagging for online conversational text with word clusters. In: HLT-NAACL, pp. 380–390 (2013)Google Scholar
  8. 8.
    Celino, I., et al.: Towards bottari: using stream reasoning to make sense of location-based micro-posts. In: The Semantic Web: ESWC 2011 Workshops, pp. 80–87. Springer (2012)Google Scholar
  9. 9. Sysomos heartbeatGoogle Scholar
  10. 10.
    Gimpel, K., et al.: Part-of-speech tagging for twitter: annotation, features, and experiments. In: 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers, vol. 2, pp. 42–47 (2011)Google Scholar
  11. 11.
    Kong, L., et al.: A dependency parser for tweets. In: International Conference on Empirical Methods in Natural Language Processing, Doha, Qatar (2014)Google Scholar
  12. 12.
    Derczynski, L., et al.: Twitter part-of-speech tagging for all: Overcoming sparse and noisy data. In: RANLP, pp. 198–206 (2013)Google Scholar
  13. 13.
    Zavitsanos, E., et al.: Gold standard evaluation of ontology learning methods through ontology transformation and alignment. IEEE Trans. Knowl. Data Eng. 23(11), 1635–1648 (2011)CrossRefGoogle Scholar

Copyright information

© Springer India 2016

Authors and Affiliations

  • R. Kaushik
    • 1
  • S. Apoorva Chandra
    • 1
  • Dilip Mallya
    • 1
  • J. N. V. K. Chaitanya
    • 1
  • S. Sowmya Kamath
    • 1
  1. 1.Department of Information TechnologyNational Institute of Technology KarnatakaMangaloreIndia

Personalised recommendations