Big Data Migration and Sentiment Analysis of Real Time Events Using Hadoop Ecosystem

  • R. ChandanaEmail author
  • D. Harshitha
  • Meenakshi
  • A. C. Ramachandra
Conference paper
Part of the Lecture Notes on Data Engineering and Communications Technologies book series (LNDECT, volume 26)


Big Data is one of the most trending topics in computer science. We all know that digital data is in unstructured format. The main purpose is to derive real-time data possessed to by different fields. Organization needs a systematic base to manage information and execute most important applications. Currently, opinions and polls that are available are the most vital part in deciding our views which in turn depicts the rate of success or impact of a product. With the stupendous widening of social media, collaborators many a times take to convey their judgement on favoured social media like twitter. Twitter data is exceptionally illuminating, it handovers a challenge for inspection because of its formidable and unorganized type. This work is a rigorous effort to plunge into the hardback domain of executing analysis of people’s sentiment [1] concerning political parties in India and also gets hold of extra pre-processing computations like deletion of repeating tweets. A method is devised wherein the tweets are categorised as positive, neutral and negative tweets [2] which is then represented through a graph which helps in depicting the chances of winning concerning a particular political party.


Big Data Sentiment analysis Real-time data Tweets 


  1. 1.
    On Language in Social Media (LSM 2011), pp 30–38. Association for Computational Linguistics (2016)Google Scholar
  2. 2.
    Galagan, P.: Twitter as a Learning Tool. Really, ASTD Learning Circuits, p. 13 (2014)Google Scholar
  3. 3.
    Turney, P.: Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In: Fortieth Annual Meeting on Association for Computational Linguistic, pp. 417–424 (2012)Google Scholar
  4. 4.
    Wilson, T., Wiebe, J., Hoffman, P.: Recognizing contextual polarity in phrase level sentiment analysis. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Proceedings (HLT/EMNLP), pp. 347–358. Association for Computational Linguistics (2015)Google Scholar
  5. 5.
    Peddinti, V., Chintalapoodi, P., Kiran, V.M.: Domain adaptation in sentiment analysis of twitter. In: AnalyzingMicrotext Workshop. AAAI (2013)Google Scholar
  6. 6.
    Bifet, A., Holmes, G., Fahringer, B.P.: MOA-Tweet Reader: Real-Time Analysis in Twitter Streaming Data LNCS 6926, p. 4660. Springer, Heidelberg (2015)Google Scholar
  7. 7.
    Gon calves, P., Ara´ujo, M., Benevenuto, F., Cha, M.: Comparing and combining sentiment analysis methods. In: Proceedings of the First ACM Conference on Online Social Networks COSN 2013, pp. 27–38. ACM, New York (2013)Google Scholar
  8. 8.
    Pang, P., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retrieval 2(1–2), 1–135 (2014)Google Scholar
  9. 9.
    Pang, P., Lee, L., Vaithyanathan, S.: Sentiment classification in machine learning techniques. In: Proceedings of ACL Conference in Natural Language Processing, vol. 10, pp. 79–88Google Scholar
  10. 10.
    Hernandez-Suarez, A., Sanchez-Perez, G., Martinez-Hernandez, V., Perez-Meana, H., Toscano-Medina, K., Nakano, M., Sanchez, V.: Predicting Political Mood Tendencies based on Twitter Data, vol. 6 (2012)Google Scholar
  11. 11.
    Amolik, A., Jivane, N., Handrail, M., Venkatesane, M.: Twitter sentiment analysis of movie reviews using machine learning techniques. Int. J. Eng. Technol. (IJET). ISSN: 0975-4024Google Scholar
  12. 12.
    Elmaseri, R., Navathe, S.: Fundamentals of Database Systems, 5th edn. Pearson/Addison Wesley, Boston (2016)Google Scholar
  13. 13.
    Medhat, W., Hassan, A., Karashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5, 1093–1113 (2014)CrossRefGoogle Scholar
  14. 14.
    Makazhanov, A., Rafiei, D.: Predicting political preference of twitter users. In: 2016 IEEE International Conference on Big Data (Big Data)Google Scholar
  15. 15.
    Mitchell, T.: Machine Learning. McGraw Hill (2014)Google Scholar
  16. 16.
    Loper, E., Bird, S.: NLTK: the natural language toolkit. In: Proceedings ACL-02 Workshop on Effective tools and methodologies for teaching natural language processingand computational linguistics, vol. 1, pp. 63–70 (2012)Google Scholar
  17. 17.
    Agarwal, A., Xie, B., Vovsha, I.: Sentiment analysis of twitter data. In: Proceedings of the WorkshopGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • R. Chandana
    • 1
    Email author
  • D. Harshitha
    • 1
  • Meenakshi
    • 1
  • A. C. Ramachandra
    • 1
  1. 1.Department of CSENMITBangaloreIndia

Personalised recommendations