Abstract
In this paper big data meaning, big data analytics and big data technologies are discussed. Hadoop ecosystem consisting of many supporting tools for data acquisition, data storage, computation model, query and analysis are also presented. For our experiment in Hadoop environment, Sample data set of temperature analysis has been taken and analyzed the role of combiner in mapper nodes towards reducing network traffic. There is a brief comparison of two leading technologies Hadoop and Spark.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Meenakshi, Latha, S., Thippeswamy, M.N.: A study on understanding big data: capture, create, analysis, applications and issues. In: National Conference on Big Data and Data Science (BADS 2015), pp. 105–109, 21 December 2015. Organized by Dayanand Sagar University, Bangalore. ISBN 978-93-85682-10-0
Hu, H., Wen, Y., Chua, T., Li, X.: Toward scalable systems for big data analytics: a technology tutorial. IEEE Trans. 2, 652–687 (2014)
Kune, R., Konugurthi, P.K., Agarwal, A., Chillarige, R.R., Buyya, R.: The Anatomy of Big Data Computing. Wiley Online Library (2015)
Manikandan, S.G., Ravi, S.: Big data analysis using Apache Hadoop. In: International Conference on IT Convergence and Security (ICITCS), pp. 1–4. IEEEE Explore, October 2014
Elagib, S.B., Najeeb, A.R., Hashim, A.H., Olanrewaju, R.F.: Big data analysis solutions using MapReduce framework. In: International Conference on Computer and Communication Engineering (ICCCE), pp. 127–130. IEEE Explore, September 2014
Saldhi, A., Yadav, D., Saksena, D., Goel, A., Saldhi, A., Indu, S.: Big data analysis using Hadoop cluster. In: International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–4. IEEE Explore, December 2014
Chandarana, P., Vijayalakshmi, M.: Big data analytics frameworks. In: International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), pp. 430–434, April 2014
Maitrey, S., Jha, C.K.: Handling big data efficiently by using map reduce technique. In: IEEE International Conference on Computational Intelligence & Communication Technology, pp. 703–708 (2015)
Apache Hadoop Documentation. www.apache.org
Bailakare, A., Meenakshi: An introduction to cloud computing and its security issues and challenges - a literature review. IJEECS 6(5) (2017)
Palanisamy, B., Singh, A., Liu, L.: Cost-effective resource provisioning for MapReduce in a cloud. Trans. Parallel Distrib. Syst. 26(5), 1265–1279 (2015)
GarcÃa-Gil, D., RamÃrez-Gallego, S., GarcÃa, S., Herrera, F.: A comparison on scalability for batch big data processing on Apache Spark and Apache Flink. Big Data Anal. 2, 1–11 (2017). ISSN 2058-6345
Acknowledgement
This paper work is supported and encouraged by all our friends and family members. We are thankful to our Institute which provides research oriented academic environment. We also would like to thank organizing committee of Conference team for providing a wonderful opportunity to publish this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Meenakshi, Ramachandra, A.C., Thippeswamy, M.N., Bailakare, A. (2019). Role of Hadoop in Big Data Handling. In: Hemanth, J., Fernando, X., Lafata, P., Baig, Z. (eds) International Conference on Intelligent Data Communication Technologies and Internet of Things (ICICI) 2018. ICICI 2018. Lecture Notes on Data Engineering and Communications Technologies, vol 26. Springer, Cham. https://doi.org/10.1007/978-3-030-03146-6_53
Download citation
DOI: https://doi.org/10.1007/978-3-030-03146-6_53
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03145-9
Online ISBN: 978-3-030-03146-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)