Abstract
With predominant use of cloud applications, the huge volume of data is generated. This generated data should be handled with minimum fault tolerance and this can be achieved with distributed file systems such as HDFS (Hadoop Distributed File System). It is an open source storage framework which is reliable, user-friendly and provides low-cost service to the consumers. As Hadoop works on large data storage thus developing the HDF system with secured data is the main concern. The security concern can be cured by adding data level encryption to protect sensitive information which avoids information leakage. This paper depicts the implementation of two symmetric cryptographic algorithms, i.e., AES and BlowFish. Later, comparative analysis for the proposed system is represented graphically in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Buyya, R., Yeo, C.S., Venugopal, S.: Cloud computing and emerging IT platforms: vision, hype and reality for delivering computing as the 5th utility. FGCS 25, 599–616 (2009)
Mohmoud, H., Hegazy, A., Khafagy, M.H.: An approach for big data security based on Hadoop distributed file system. ITCE Egypt, pp. 109–114 (2018)
Dean, J., Ghemavat, S.: MapReduce: simplified data processing on large clusters. Commun ACM 51, 107–113 (2008)
Vishal Reddy, K., Patil, J.B., Deshmukh, R.R.: Security issues in Hadoop framework: a review. IJSEM 3(2), 193–198 (2018)
Alam, M.B.: A new HDFS structure model to evaluate the performance of wordcount application on different file size 111(3), 1–4 (2015)
White T.: Hadoop: The Definitive Guide, 1st edn. O’Reilly Media (2009)
NVIDIA CUDA programming guide
Deshpande, P., Sharma, S.C., Peddoju, S.K.: Data storage security in cloud paradigm. In: Proceedings of Fifth International Conference on Soft Computing for Problem Solving, vol. 436, pp. 247–259 (2016)
Deshpande, P., Sharma, S.C., Peddoju, S.K.: Security and service assurance issues in cloud environment. Int. J. Syst. Assur. Eng. Manag. 9(1), 194–207 (2018)
Park, S., Lee, Y.S.: Secure Hadoop with Encrypted HDFS, pp. 134–141 (2013)
Kin, H.Y., Shen, S.T., Tzeng, W.G.: Toward data confidentiality via integrating hybrid encryption schemes and Hadoop distributed file system. In: International Conference on Advanced Information Networking and Applications, AINA, pp. 740–747 (2017)
Shetty, M.M., Manjaiah, D.H.: Data security in Hadoop distributed file system. In: IEEE International Conference on Emerging Technological Trends in Computing Communication, ICETT 2016, pp. 939–944 (2017)
O’Malley, O., Zhang, K., Marti, R.S.: Hadoop security design technical report (2009)
Cordova, A.: MapReduce over Tahoe. Hadoop world (2009)
Majors, J.H.: Secdoop: a confidentiality in secure Hadoop clusters. Alburn University. Master Thesis, May 2011
Yang, Y., Wu, Z., Yang, X.: Security architecture of private storage cloud based on HDFS. In: 26th IEEE w/s ICAIN&A (2012)
Al-Kiswany, S., Gharaibeh, A., Santos-Neto, E.: StoreGPU: exploiting graphics processing units to accelerate distributed storage system. ACm HPDC (2008)
Sun, W., Ricci, R., Curry, M.L.: Harnessing GPU computing for storage systems in the OS Kernel. ACM SYSTOR (2012)
http://software.intel.com/en-us/articles/intel-advanced-encryption-standard-instructions-aes-ni
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Vishal Reddy, K., Patil, J.B., Deshmukh, R.R. (2020). A Comparative Approach to Secure Data Storage Model in Hadoop Framework. In: Iyer, B., Deshpande, P., Sharma, S., Shiurkar, U. (eds) Computing in Engineering and Technology. Advances in Intelligent Systems and Computing, vol 1025. Springer, Singapore. https://doi.org/10.1007/978-981-32-9515-5_13
Download citation
DOI: https://doi.org/10.1007/978-981-32-9515-5_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9514-8
Online ISBN: 978-981-32-9515-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)