Abstract
In the world of big data and Internet of things (IoT), data grows exponentially in terms of petabytes, and subsequent processing in large scale needs commodity-based clusters to run these applications. Mobile users cannot get the commodity cluster to run parallel, complex, and scientific applications. The portable devices can form a cloudlet and use the cloud based on available resources and required resources which can be taken care by our proposed scheduler engine. We are aware that the mobile devices have resource limitations, however the combinations of several component such as portable devices and cloud computing will help to fulfill the limitation in terms of resources. To encounter the problem of performing data intensive jobs using the mobile devices and also achieve interoperability with the cloudlet and different vendors of the cloud, we have proposed various architectures to integrate IoT and big data along with MCC. The proposed architectures use middleware for the integration of MCC and big data for various technological frameworks; in our approach, we use various appliances, sensors, and portable devices having efficient utilization of the resources on the cloud and cloudlets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apache flink. http://flink.apache.org/.
Apache giraph. http://giraph.apache.org/.
Apache hadoop. http://hadoop.apache.org/.
Apache storm. http://storm.apache.org/.
Ibm infosphere streams. http://www-03.ibm.com/software/products/en/ibm-streams.
Twister. http://www.iterativemapreduce.org/.
K. Akherfi, H. Harroud, and M. Gerndt. A mobile cloud middleware to support mobility and cloud interoperability. IJARAS, 7(1):41–58, 2016.
Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. Haloop: Efficient iterative data processing on large clusters. PVLDB, 3(1):285–296, 2010.
B.-G. Chun, S. Ihm, P. Maniatis, M. Naik, and A. Patti. Clonecloud: elastic execution between mobile device and cloud. In C. M. Kirsch and G. Heiser, editors, EuroSys, pages 301–314. ACM, 2011.
J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative mapreduce. In S. Hariri and K. Keahey, editors, HPDC, pages 810–818. ACM, 2010.
J. E. Gonzalez, R. S. Xin, A. Dave, D. Crankshaw, M. J. Franklin, and I. Stoica. Graphx: Graph processing in a distributed dataflow framework. In J. Flinn and H. Levy, editors, OSDI, pages 599–613. USENIX Association, 2014.
D. T. Hoang, C. Lee, D. Niyato, and P. Wang. A survey of mobile cloud computing: architecture, applications, and approaches. Wireless Communications and Mobile Computing, 13(18):1587–1611, 2013.
Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M. Hellerstein. Distributed graphlab: A framework for machine learning in the cloud. PVLDB, 5(8):716–727, 2012.
S. Ou, K. Yang, and J. Zhang. An effective offloading middleware for pervasive services on mobile devices. Pervasive and Mobile Computing, 3(4):362–385, 2007.
P. S. V. S. S. Prasad, H. B. Subrahmanyam, and P. K. Singh. Scalable iqra_ig algorithm: An iterative mapreduce approach for reduct computation. In P. Krishnan, P. R. Krishna, and L. Parida, editors, ICDCIT, volume 10109 of Lecture Notes in Computer Science, pages 58–69. Springer, 2017.
P. K. Singh and P. S. V. S. S. Prasad. Scalable quick reduct algorithm: Iterative mapreduce approach. In CODS, 2016.
C. E. Tsourakakis. Pegasus: A system for large-scale graph processing. In S. Sakr and M. M. Gaber, editors, Large Scale and Big Data, pages 255–286. Auerbach Publications, 2014.
B. Yin, W. Shen, L. X. Cai, and Y. Cheng. A mobile cloud computing middleware for low latency offloading of big data. In Q. Li and D. Xuan, editors, Mobidata@MobiHoc, pages 31–35. ACM, 2015.
M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In E. M. Nahum and D. Xu, editors, HotCloud. USENIX Association, 2010.
M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica. Discretized streams: An efficient and fault-tolerant model for stream processing on large clusters. In R. Fonseca and D. A. Maltz, editors, HotCloud. USENIX Association, 2012.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Singh, P.K., Verma, R.K., Sarkar, J.L. (2019). MCC and Big Data Integration for Various Technological Frameworks. In: Panigrahi, C., Pujari, A., Misra, S., Pati, B., Li, KC. (eds) Progress in Advanced Computing and Intelligent Engineering. Advances in Intelligent Systems and Computing, vol 714. Springer, Singapore. https://doi.org/10.1007/978-981-13-0224-4_36
Download citation
DOI: https://doi.org/10.1007/978-981-13-0224-4_36
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-0223-7
Online ISBN: 978-981-13-0224-4
eBook Packages: EngineeringEngineering (R0)