Abstract
Data processing can achieve desirable efficiency on a Graphics Process Unit cluster in the Compute Unified Device Architecture (CUDU) environment. However, the storage power and computing power of CUDA in the single-node environment has become the bottleneck of massive data processing. In order to process massive data efficiently in the CUDA environment, a computing framework for massive data processing is provided: CUDA on Hadoop. It combines CUDA and Hadoop that enhances the data throughput of CUDA applications by utilizing the distributed computing technology of Hadoop through a general interface for CUDA applications. In this paper, the details of the design and implementation of CUDA on Hadoop are illustrated as well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apache Hadoop, http://hadoop.apache.org/
He B, Fang W, Govindaraju NK, Luo Q, Wang T (2008) Mars: a MapReduce framework on graphics processors. In: Proceedings of the 17th international conference on parallel architectures and compilation techniques, pp 260–269
Ranger C, Raghuraman R, Penmetsa A, Bardski G, Kozyrakis C (2007) Evaluating MapReduce for multi-core and multiprocessor systems. In: HPCA’07 Proceedings of the 2007 IEEE 13th international symposium on high performance computer architecture, Washington, DC, USA. IEEE Computer Society, pp 13–24
Fan W, Chen X, Li X (2010) Parallelization of RSA algorithm based on compute unified device architecture. In: Proceedings of the 9th international conference on grid and cooperative computing (GCC)
Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113
White T (2009) Hadoop: the definitive guide, 1st edn. O’Reilly Media, Inc, Sebastopol
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Z., Lv, P., Zheng, C. (2014). CUDA on Hadoop: A Mixed Computing Framework for Massive Data Processing. In: Sun, F., Hu, D., Liu, H. (eds) Foundations and Practical Applications of Cognitive Systems and Information Processing. Advances in Intelligent Systems and Computing, vol 215. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37835-5_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-37835-5_23
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37834-8
Online ISBN: 978-3-642-37835-5
eBook Packages: EngineeringEngineering (R0)