Skip to main content

MCC and Big Data Integration for Various Technological Frameworks

  • Conference paper
  • First Online:
Progress in Advanced Computing and Intelligent Engineering

Abstract

In the world of big data and Internet of things (IoT), data grows exponentially in terms of petabytes, and subsequent processing in large scale needs commodity-based clusters to run these applications. Mobile users cannot get the commodity cluster to run parallel, complex, and scientific applications. The portable devices can form a cloudlet and use the cloud based on available resources and required resources which can be taken care by our proposed scheduler engine. We are aware that the mobile devices have resource limitations, however the combinations of several component such as portable devices and cloud computing will help to fulfill the limitation in terms of resources. To encounter the problem of performing data intensive jobs using the mobile devices and also achieve interoperability with the cloudlet and different vendors of the cloud, we have proposed various architectures to integrate IoT and big data along with MCC. The proposed architectures use middleware for the integration of MCC and big data for various technological frameworks; in our approach, we use various appliances, sensors, and portable devices having efficient utilization of the resources on the cloud and cloudlets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apache flink. http://flink.apache.org/.

  2. Apache giraph. http://giraph.apache.org/.

  3. Apache hadoop. http://hadoop.apache.org/.

  4. Apache storm. http://storm.apache.org/.

  5. Ibm infosphere streams. http://www-03.ibm.com/software/products/en/ibm-streams.

  6. Twister. http://www.iterativemapreduce.org/.

  7. K. Akherfi, H. Harroud, and M. Gerndt. A mobile cloud middleware to support mobility and cloud interoperability. IJARAS, 7(1):41–58, 2016.

    Google Scholar 

  8. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. Haloop: Efficient iterative data processing on large clusters. PVLDB, 3(1):285–296, 2010.

    Google Scholar 

  9. B.-G. Chun, S. Ihm, P. Maniatis, M. Naik, and A. Patti. Clonecloud: elastic execution between mobile device and cloud. In C. M. Kirsch and G. Heiser, editors, EuroSys, pages 301–314. ACM, 2011.

    Google Scholar 

  10. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative mapreduce. In S. Hariri and K. Keahey, editors, HPDC, pages 810–818. ACM, 2010.

    Google Scholar 

  11. J. E. Gonzalez, R. S. Xin, A. Dave, D. Crankshaw, M. J. Franklin, and I. Stoica. Graphx: Graph processing in a distributed dataflow framework. In J. Flinn and H. Levy, editors, OSDI, pages 599–613. USENIX Association, 2014.

    Google Scholar 

  12. D. T. Hoang, C. Lee, D. Niyato, and P. Wang. A survey of mobile cloud computing: architecture, applications, and approaches. Wireless Communications and Mobile Computing, 13(18):1587–1611, 2013.

    Article  Google Scholar 

  13. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M. Hellerstein. Distributed graphlab: A framework for machine learning in the cloud. PVLDB, 5(8):716–727, 2012.

    Google Scholar 

  14. S. Ou, K. Yang, and J. Zhang. An effective offloading middleware for pervasive services on mobile devices. Pervasive and Mobile Computing, 3(4):362–385, 2007.

    Article  Google Scholar 

  15. P. S. V. S. S. Prasad, H. B. Subrahmanyam, and P. K. Singh. Scalable iqra_ig algorithm: An iterative mapreduce approach for reduct computation. In P. Krishnan, P. R. Krishna, and L. Parida, editors, ICDCIT, volume 10109 of Lecture Notes in Computer Science, pages 58–69. Springer, 2017.

    Google Scholar 

  16. P. K. Singh and P. S. V. S. S. Prasad. Scalable quick reduct algorithm: Iterative mapreduce approach. In CODS, 2016.

    Google Scholar 

  17. C. E. Tsourakakis. Pegasus: A system for large-scale graph processing. In S. Sakr and M. M. Gaber, editors, Large Scale and Big Data, pages 255–286. Auerbach Publications, 2014.

    Google Scholar 

  18. B. Yin, W. Shen, L. X. Cai, and Y. Cheng. A mobile cloud computing middleware for low latency offloading of big data. In Q. Li and D. Xuan, editors, Mobidata@MobiHoc, pages 31–35. ACM, 2015.

    Google Scholar 

  19. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In E. M. Nahum and D. Xu, editors, HotCloud. USENIX Association, 2010.

    Google Scholar 

  20. M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica. Discretized streams: An efficient and fault-tolerant model for stream processing on large clusters. In R. Fonseca and D. A. Maltz, editors, HotCloud. USENIX Association, 2012.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Praveen Kumar Singh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Singh, P.K., Verma, R.K., Sarkar, J.L. (2019). MCC and Big Data Integration for Various Technological Frameworks. In: Panigrahi, C., Pujari, A., Misra, S., Pati, B., Li, KC. (eds) Progress in Advanced Computing and Intelligent Engineering. Advances in Intelligent Systems and Computing, vol 714. Springer, Singapore. https://doi.org/10.1007/978-981-13-0224-4_36

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-0224-4_36

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-0223-7

  • Online ISBN: 978-981-13-0224-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics