Learning Contextual Knowledge Structures from the Web for Facilitating Semantic Interpretation of Tweets

  • Nazura JavedEmail author
  • Muralidhara B. L.
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 34)


Tweet analysis can provide valuable insight into societal issues and opinions. The terse, cryptic tweets, however, cannot be interpreted on face value. Interpretation assumes contextual knowledge. We propose a novel methodology of extracting structured contextual knowledge for popular topics/events and building knowledge structures using mining and computational linguistics techniques. We crunch relevant context contents from online sources and structure the same as contextual knowledge structures (CKSs). These automatically extracted CKS are (a) structured as subject–predicate–object triples, (b) they are relevant because they are built by mining contextual Web content, and (c) they are scalable to ontology and can be used for training classifiers. We demonstrate the feasibility and effectiveness of this methodology with an experiment which captures tweets of Indian political leaders, taps the related Web content, and transforms the same into CKS. The novel contribution of this work is its synergistic approach which combines acquisition, organization, and summarization with scalability to contextual ontology for social media analytics.


Social media mining Contextual knowledge structures Text mining Computational linguistics Machine learning 


  1. 1.
    Batrinca, B., Treleaven, P.C.: Social media analytics: a survey of techniques, tools and platforms. AI Soc. 30(1), 89–116 (2015)CrossRefGoogle Scholar
  2. 2.
    Javed, N., Muralidhara, B.L.: Automating corpora generation with semantic cleaning and tagging of tweets for multi-dimensional social media analytics. Int. J. Comput. Appl. 127(12), 11–16 (2015)CrossRefGoogle Scholar
  3. 3.
    Chai, X., Deshpande, O., Garera, N., Gattani, A., Lam, W., Lamba, D.S., Prasad, S.T.S.: Social media analytics: the Kosmix story. IEEE Data Eng. Bull. 36(3), 4–12 (2013)Google Scholar
  4. 4.
    Tiwari, V., Thakur, R.S.: Pattern warehouse: context based modeling and quality issues. In: Proceedings of the National Academy of Sciences, India Section A: Physical Sciences, vol. 86, pp. 417–431. Springer, Berlin (2016)CrossRefGoogle Scholar
  5. 5.
    Tiwari, V., & Thakur, R.S.: Contextual snowflake modelling for pattern warehouse logical design. In: Sadhana-Academy Proceedings in Engineering Science, vol. 40, pp. 15–33. Springer, Berlin (2015)Google Scholar
  6. 6.
    Lehmann, J., Isele, R., Jakob, M., Jentzsch, A., Kontokostas, D., Mendes, P.N., Bizer, C.: DBpedia—a large-scale, multilingual knowledge base extracted from Wikipedia. Semant. Web 6(2), 167–195 (2015)Google Scholar
  7. 7.
    Liu, H., Singh, P.: ConceptNet—a practical commonsense reasoning tool-kit. BT Technol. J. 22(4), 211–226 (2004)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Zeng, D., Chen, H., Lusch, R., Li, S.: Social media analytics and intelligence. IEEE Intell. Syst. 25(6), 13–16 (2010)CrossRefGoogle Scholar
  10. 10.
    Li, C., Sun, A., Weng, J., He, Q.: Tweet segmentation and its application to named entity recognition. IEEE Trans. Knowl. Data Eng. 27(2), 558–570 (2015)CrossRefGoogle Scholar
  11. 11.
    Kaufmann, J., Kalita, J.: Syntactic normalization of twitter messages. In: International Conference on Natural Language Processing (ICON 2011), December, Kharagpur, India, pp. 149–158 (2011)Google Scholar
  12. 12.
    Sriram, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., Demirbas, M.: Short text classification in twitter to improve information filtering. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 841–842, ACM (2010)Google Scholar
  13. 13.
    Gomadam, K., Yeh, P. Z., Verma, K., Miller, J. A. Data Enrichment using Web APIs. In: 2012 IEEE First International Conference on Services Economics, pp. 46–53, 2012Google Scholar
  14. 14.
    Jadhav, A.S., Purohit, H., Kapanipathi, P., Anantharam, P., Ranabahu, A.H., Nguyen, V., Sheth, A.P.: Twitris 2.0: semantically empowered system for understanding perceptions from social data (2010)Google Scholar
  15. 15.
    Villanueva, D., González-Carrasco, I., López-Cuadrado, J.L., Lado, N.: SMORE: towards a semantic modeling for knowledge representation on social media. Sci. Comput. Progr. (2015)Google Scholar
  16. 16.
    Warren, P., Davies, J., Simperl, E.: Context and semantics for knowledge management: technologies for personal productivity. Springer Science & Business Media (2011)Google Scholar
  17. 17.
    Niu, F., Zhang, C., Ré, C., Shavlik, J.: Elementary: large-scale knowledge-base construction via machine learning and statistical inference. Int. J. Semant. Web Inf. Syst. (IJSWIS) 8(3), 42–73 (2012)CrossRefGoogle Scholar
  18. 18.
    Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, Jr., E., Mitchell, T.: Toward an architecture for never-ending language learning. In: AAAI (2010)Google Scholar
  19. 19.
    Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Zhang, W.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 601–610. ACM (2014)Google Scholar
  20. 20.; web Intelligence and Visual Analytics
  21. 21.
    Scharl, A., Weichselbraun, A., Rafelsberger, W., Kamolov, R.: Scalable knowledge extraction and visualization for web intelligence. In: 2016 49th Hawaii International Conference on System Sciences (HICSS), pp. 3749–3757 (2016)Google Scholar
  22. 22.
  23. 23.
    De Marneffe, M.C., MacCartney, B., Manning, C.D.: Generating typed dependency parses from phrase structure parses. Proc. LREC 6(2006), 449–454 (2006)Google Scholar
  24. 24.
    Liu, H.: MontyLingua: an end-to-end natural language processor with common sense. Available at:

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of Computer Science and ApplicationsBangalore UniversityBengaluruIndia

Personalised recommendations