Skip to main content
SpringerLink
Log in

A Data Security Storage Method for IoT Under Hadoop Cloud Computing Platform

  • Published:
International Journal of Wireless Information Networks Aims and scope Submit manuscript

Abstract

Taking the big data storage for internet of things (IoT) in the cloud computing environment as the research object, the paper mainly introduces two typical distributed storage systems in the cloud computing environment, namely Google’s GFS and Hadoop’s HDFS. The data storage technology is specially analyzed. The prior art was evaluated in terms of scalability and latency (how to support the storage of large amounts of small files), fault tolerance (data recovery in the event of data loss), and real-time performance of mass data storage. On this basis, the system architecture of the distributed file system is proposed. Aiming at the problem of IoT data security storage in cloud computing, an enhanced ant colony algorithm for data storage is proposed. The algorithm considers the shortest completion time and load balancing of data storage. At the same time, it refers to various improvements of ant colony algorithm in recent years, and innovatively assigns a task on a virtual machine as an ant search object. Experiments have shown that this method is effective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. L. Jiang, L. D. Xu, H. Cai, et al., An IoT-oriented data storage framework in cloud computing platform, IEEE Transactions on Industrial Informatics, Vol. 10, No. 2, pp. 1443–1451, 2014.

    Article  Google Scholar 

  2. W. Wang, P. Xu and L. T. Yang, Secure data collection, storage and access in cloud-assisted IoT, IEEE Cloud Computing, Vol. PP, No. 99, pp. 1–11, 2018.

    Google Scholar 

  3. B. Zhang, X. W. Wang and M. Huang, A data replica placement scheme for cloud storage under healthcare IoT environment, Applied Mechanics and Materials, Vol. 556–562, pp. 5511–5517, 2014.

    Article  Google Scholar 

  4. L. Wang, J. Shen and J. Luo, Facilitating an ant colony algorithm for multi-objective data-intensive service provision, Journal of Computer and System Sciences, Vol. 81, No. 4, pp. 734–746, 2015.

    Article  MathSciNet  MATH  Google Scholar 

  5. Z. Xiaodong, C. Xiaoyan and Z. Shizhuo, Heuristic task scheduling algorithm based on rational ant colony optimization, Chinese Journal of Electronics, Vol. 23, No. 2, pp. 311–314, 2014.

    Google Scholar 

  6. M. Lehmann, J. Barnes, G. R. Ridgway, et al., Task scheduling of parallel programming systems using ant colony optimization, Proceedings of the International Symposium on Computer Science, Vol. 5978, No. 1, pp. 179–182, 2014.

    Google Scholar 

  7. R. Singh and P. J. Kaur, Analyzing performance of Apache Tez and MapReduce with Hadoop multinode cluster on Amazon cloud, Journal of Big Data, Vol. 3, No. 1, pp. 19–24, 2016.

    Article  MathSciNet  Google Scholar 

  8. H. Cai, B. Xu, L. Jiang, et al., IoT-based big data storage systems in cloud computing: perspectives and challenges, IEEE Internet of Things Journal, Vol. 4, No. 1, pp. 75–87, 2017.

    Google Scholar 

  9. R. Girau, S. Martis and L. Atzori, Lysis: a platform for IoT distributed applications over socially connected objects, IEEE Internet of Things Journal, Vol. 4, No. 1, pp. 40–51, 2017.

    Google Scholar 

  10. W. D. Zhang, X. Q. Ding and R. C. Hou, Hadoop and PaaS collaborative practice research in video monitoring platform, Applied Mechanics and Materials, Vol. 543–547, pp. 3549–3554, 2014.

    Article  Google Scholar 

  11. M. M. Rathore, A. Ahmad, A. Paul, et al., Real-time medical emergency response system: exploiting IoT and big data for public health, Journal of Medical Systems, Vol. 40, No. 12, pp. 1–10, 2016.

    Article  Google Scholar 

  12. M. A. Ahad and R. Biswas, Comparing and analyzing the characteristics of Hadoop, cassandra and Quantcast file systems for handling big data, Indian Journal of Science and Technology, Vol. 10, No. 8, pp. 1–6, 2017.

    Article  Google Scholar 

  13. Z. Wang, D. Chen and L. I. Ling, Design and implementation of personalized information customization system based on Hadoop cloud platform, Journal of Jilin University, Vol. 34, No. 2, pp. 271–277, 2016.

    Google Scholar 

  14. H. Y. Yang and L. X. Meng, Hadoop cloud platform dynamic access control based on user behavior assessment, Transactions of Beijing Institute of Technology, Vol. 37, No. 10, pp. 1031–1035, 2017.

    MATH  Google Scholar 

  15. A. Paul, A. Ahmad, S. Jabbar, et al., Smartbuddy: defining human behaviors using big data analytics in social internet of things, IEEE Wireless Communications, Vol. 23, No. 5, pp. 68–74, 2016.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Cyberspace Security, Hunan College of Information, Changsha, 410200, Hunan, China

    Yuqing Mo

Authors
  1. Yuqing Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuqing Mo.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mo, Y. A Data Security Storage Method for IoT Under Hadoop Cloud Computing Platform. Int J Wireless Inf Networks 26, 152–157 (2019). https://doi.org/10.1007/s10776-019-00434-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10776-019-00434-x

Keywords

Search

Navigation