Skip to main content
SpringerLink
Log in

Performance Evaluation of MapReduce Applications on Cloud Computing Environment, FutureGrid

  • Conference paper
Grid and Distributed Computing (GDC 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 261))

Included in the following conference series:

Abstract

This paper describes the result of performance evaluation of two kinds of MapReduce applications running in the FutureGrid: a data intensive application and a computation intensive application. For this work, we construct a virtualized cluster system made of a set of VM instances. We observe that the overall performance of a data intensive application is strongly affected by the configuration of the VMs. It can be used to identify the bottleneck of the MapReduce application running on the virtualized cluster system with various VM instances.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I., Zaharia, M.: Above the Clouds: A Berkeley View of Cloud Computing. EECS Department. University of California, Berkeley (2009)

    Google Scholar 

  2. https://portal.futuregrid.org/

  3. Dean, J., Ghemawat, S.: MapReduce: A Flexible Data Processing Tool. Commun. ACM 53, 72–77 (2010)

    Article  Google Scholar 

  4. Morton, K., Friesen, A., Balazinska, M., Grossman, D.: Estimating the Progress of MapReduce Pipelines. In: IEEE 26th International Conference on Data Engineering (ICDE), Long Beach, CA, pp. 681–684 (2010)

    Google Scholar 

  5. Dean, J., Ghemawat, S.: Mapreduce: Simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)

    Article  Google Scholar 

  6. Wang, F., Qiu, J., Yang, J., Dong, B., Li, X., Li, Y.: Hadoop high availability through metadata replication. In: Proceeding of the First International Workshop on Cloud Data Management, Hong Kong, China, pp. 37–44 (2009)

    Google Scholar 

  7. Grossman, R., Gu, Y.: Data mining using high performance data clouds: experimental studies using sector and sphere. In: Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 920–927. ACM, Las Vegas (2008)

    Chapter  Google Scholar 

  8. Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S.-H., Qiu, J., Fox, G.: Twister: A Runtime for Iterative MapReduce. In: The First International Workshop on MapReduce and its Applications (MAPREDUCE 2010) - HPDC 2010 (2010)

    Google Scholar 

  9. Fox, G., Pallickara, S.: Deploying the NaradaBrokering Substrate in Aiding Efficient Web & Grid Service Interactions. Invited paper for Special Issue of the Proceedings of the IEEE on Grid Computing 93(3), 564–577 (2005)

    Google Scholar 

  10. MPI. MPI(Message Passing Interface), http://www-unix.mcs.anl.gov/mpi/

  11. PVM. PVM(Parallel Virtual Machine), http://www.csm.ornl.gov/pvm/

Download references

Author information

Authors and Affiliations

  1. Division of Information and Communication, Baekseok University, 115 Anseo Dong, Cheonan, Korea, 330-704

    Yunhee Kang

  2. Pervasive Technology Institute, Indiana University, 2719 E 10th St., Bloomington, Indiana, IN 47408, USA

    Geoffrey C. Fox

Authors
  1. Yunhee Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Geoffrey C. Fox
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Multimedia Engineering Department, Hannam University, 133 Ojeong-dong, Daeduk-gu, Daejeon, Korea

    Tai-hoon Kim

  2. The Ohio State University, 470 Hitchcock Hall, 2070 Neil Avenue, 43210-1275, Columbus, OH, USA

    Hojjat Adeli

  3. Chungwoon University, 350-701, Chungnam, Korea

    Hyun-seob Cho

  4. Department of Mathematics and Computer Science, University of Perugia, Via Vanvitelli, 1, 06123, Perugia, Italy

    Osvaldo Gervasi

  5. Department of Computer Science and Engineering, Arizona State University, 85281, Mesa, AZ, USA

    Stephen S. Yau

  6. School of Computing and Information Systems, University of Tasmania, Hobart, TAS, Australia

    Byeong-Ho Kang

  7. Universidad Complutense de Madrid, 28040, Madrid, Spain

    Javier García Villalba

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kang, Y., Fox, G.C. (2011). Performance Evaluation of MapReduce Applications on Cloud Computing Environment, FutureGrid. In: Kim, Th., et al. Grid and Distributed Computing. GDC 2011. Communications in Computer and Information Science, vol 261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27180-9_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27180-9_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-27179-3

  • Online ISBN: 978-3-642-27180-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation