Role of Hadoop in Big Data Handling
In this paper big data meaning, big data analytics and big data technologies are discussed. Hadoop ecosystem consisting of many supporting tools for data acquisition, data storage, computation model, query and analysis are also presented. For our experiment in Hadoop environment, Sample data set of temperature analysis has been taken and analyzed the role of combiner in mapper nodes towards reducing network traffic. There is a brief comparison of two leading technologies Hadoop and Spark.
KeywordsAnalytics Big Data Combiner Cloud Hadoop MapReduce Spark
This paper work is supported and encouraged by all our friends and family members. We are thankful to our Institute which provides research oriented academic environment. We also would like to thank organizing committee of Conference team for providing a wonderful opportunity to publish this paper.
- 1.Meenakshi, Latha, S., Thippeswamy, M.N.: A study on understanding big data: capture, create, analysis, applications and issues. In: National Conference on Big Data and Data Science (BADS 2015), pp. 105–109, 21 December 2015. Organized by Dayanand Sagar University, Bangalore. ISBN 978-93-85682-10-0Google Scholar
- 2.Hu, H., Wen, Y., Chua, T., Li, X.: Toward scalable systems for big data analytics: a technology tutorial. IEEE Trans. 2, 652–687 (2014)Google Scholar
- 3.Kune, R., Konugurthi, P.K., Agarwal, A., Chillarige, R.R., Buyya, R.: The Anatomy of Big Data Computing. Wiley Online Library (2015)Google Scholar
- 4.Manikandan, S.G., Ravi, S.: Big data analysis using Apache Hadoop. In: International Conference on IT Convergence and Security (ICITCS), pp. 1–4. IEEEE Explore, October 2014Google Scholar
- 5.Elagib, S.B., Najeeb, A.R., Hashim, A.H., Olanrewaju, R.F.: Big data analysis solutions using MapReduce framework. In: International Conference on Computer and Communication Engineering (ICCCE), pp. 127–130. IEEE Explore, September 2014Google Scholar
- 6.Saldhi, A., Yadav, D., Saksena, D., Goel, A., Saldhi, A., Indu, S.: Big data analysis using Hadoop cluster. In: International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–4. IEEE Explore, December 2014Google Scholar
- 7.Chandarana, P., Vijayalakshmi, M.: Big data analytics frameworks. In: International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), pp. 430–434, April 2014Google Scholar
- 8.Maitrey, S., Jha, C.K.: Handling big data efficiently by using map reduce technique. In: IEEE International Conference on Computational Intelligence & Communication Technology, pp. 703–708 (2015)Google Scholar
- 9.Apache Hadoop Documentation. www.apache.org
- 10.Bailakare, A., Meenakshi: An introduction to cloud computing and its security issues and challenges - a literature review. IJEECS 6(5) (2017)Google Scholar