Advertisement

Role of Hadoop in Big Data Handling

  • MeenakshiEmail author
  • A. C. Ramachandra
  • M. N. Thippeswamy
  • Ajith Bailakare
Conference paper
Part of the Lecture Notes on Data Engineering and Communications Technologies book series (LNDECT, volume 26)

Abstract

In this paper big data meaning, big data analytics and big data technologies are discussed. Hadoop ecosystem consisting of many supporting tools for data acquisition, data storage, computation model, query and analysis are also presented. For our experiment in Hadoop environment, Sample data set of temperature analysis has been taken and analyzed the role of combiner in mapper nodes towards reducing network traffic. There is a brief comparison of two leading technologies Hadoop and Spark.

Keywords

Analytics Big Data Combiner Cloud Hadoop MapReduce Spark 

Notes

Acknowledgement

This paper work is supported and encouraged by all our friends and family members. We are thankful to our Institute which provides research oriented academic environment. We also would like to thank organizing committee of Conference team for providing a wonderful opportunity to publish this paper.

References

  1. 1.
    Meenakshi, Latha, S., Thippeswamy, M.N.: A study on understanding big data: capture, create, analysis, applications and issues. In: National Conference on Big Data and Data Science (BADS 2015), pp. 105–109, 21 December 2015. Organized by Dayanand Sagar University, Bangalore. ISBN 978-93-85682-10-0Google Scholar
  2. 2.
    Hu, H., Wen, Y., Chua, T., Li, X.: Toward scalable systems for big data analytics: a technology tutorial. IEEE Trans. 2, 652–687 (2014)Google Scholar
  3. 3.
    Kune, R., Konugurthi, P.K., Agarwal, A., Chillarige, R.R., Buyya, R.: The Anatomy of Big Data Computing. Wiley Online Library (2015)Google Scholar
  4. 4.
    Manikandan, S.G., Ravi, S.: Big data analysis using Apache Hadoop. In: International Conference on IT Convergence and Security (ICITCS), pp. 1–4. IEEEE Explore, October 2014Google Scholar
  5. 5.
    Elagib, S.B., Najeeb, A.R., Hashim, A.H., Olanrewaju, R.F.: Big data analysis solutions using MapReduce framework. In: International Conference on Computer and Communication Engineering (ICCCE), pp. 127–130. IEEE Explore, September 2014Google Scholar
  6. 6.
    Saldhi, A., Yadav, D., Saksena, D., Goel, A., Saldhi, A., Indu, S.: Big data analysis using Hadoop cluster. In: International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–4. IEEE Explore, December 2014Google Scholar
  7. 7.
    Chandarana, P., Vijayalakshmi, M.: Big data analytics frameworks. In: International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), pp. 430–434, April 2014Google Scholar
  8. 8.
    Maitrey, S., Jha, C.K.: Handling big data efficiently by using map reduce technique. In: IEEE International Conference on Computational Intelligence & Communication Technology, pp. 703–708 (2015)Google Scholar
  9. 9.
    Apache Hadoop Documentation. www.apache.org
  10. 10.
    Bailakare, A., Meenakshi: An introduction to cloud computing and its security issues and challenges - a literature review. IJEECS 6(5) (2017)Google Scholar
  11. 11.
    Palanisamy, B., Singh, A., Liu, L.: Cost-effective resource provisioning for MapReduce in a cloud. Trans. Parallel Distrib. Syst. 26(5), 1265–1279 (2015)CrossRefGoogle Scholar
  12. 12.
    García-Gil, D., Ramírez-Gallego, S., García, S., Herrera, F.: A comparison on scalability for batch big data processing on Apache Spark and Apache Flink. Big Data Anal. 2, 1–11 (2017). ISSN 2058-6345CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Meenakshi
    • 1
    Email author
  • A. C. Ramachandra
    • 1
  • M. N. Thippeswamy
    • 1
  • Ajith Bailakare
    • 2
  1. 1.Department of Computer Science and EngineeringNitte Meenakshi Institute of TechnologyBangaloreIndia
  2. 2.Digital Electronics, UTL BangaloreBangaloreIndia

Personalised recommendations