Advertisement

Resource Management for Hybrid Grid and Cloud Computing

  • Simon OstermannEmail author
  • Radu Prodan
  • Thomas Fahringer
Chapter
Part of the Computer Communications and Networks book series (CCN)

Abstract

From its start of using supercomputers, scientific computing constantly evolved to the next levels such as cluster computing, meta-computing, or computational Grids. Today, Cloud Computing is emerging as the paradigm for the next generation of large-scale scientific computing, eliminating the need for hosting expensive computing hardware. Scientists still have their Grid environments in place and can benefit from extending them using leased Cloud resources whenever needed. This paradigm shift opens new problems that need to be analyzed, such as integration of this new resource class into existing environments, applications on the resources, and security. The virtualization overheads for deployment and starting of a virtual machine image are new factors, which will need to be considered when choosing scheduling mechanisms. In this chapter, we investigate the usability of compute Clouds to extend a Grid workflow middleware and show on a real implementation that this can speed up executions of scientific workflows.

Keywords

Cloud Computing Cloud Provider Grid Resource Grid Environment Cloud Resource 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Iosup A, Dumitrescu C, Epema D, Li H, Wolters L (2006) How are real grids used? The analysis of four grid traces and its implications. In international conference on grid computing, IEEE Computer Society, pp 262–269Google Scholar
  2. 2.
    Costa GD, Dikaiakos MD, Orlando S (2007) Analyzing the workload of the south-east federation of the egee grid infrastructure, CoreGRID Technical Report, Tech. Rep. TR-0063, 2007Google Scholar
  3. 3.
    Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. ACM SIGMOD Rec 34(3):44–49CrossRefGoogle Scholar
  4. 4.
    Deelman E, Singh G, Livny M, Berriman JB, Good J (2008) The cost of doing science on the cloud: the montage example. In proceedings of the ACM/IEEE conference on high performance computing, SC 2008. IEEE/ACM, Austin, Texas, USA, p 50Google Scholar
  5. 5.
    Assuncao ACM, Buyya R (2009) Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In: Kranzlmüller D, Bode A, Hegering H.-G, Casanova H, Gerndt M (eds) 11th IEEE international conference on high performance computing and communications (HPCC 2009), ACMGoogle Scholar
  6. 6.
    Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, Zagorodnov D (2008) Eucalyptus: a technical report on an elastic utility computing architecture linking your programs to useful systems. UCSB Computer Science Technical Report, Tech. Rep. 2008–10, 2008Google Scholar
  7. 7.
    Chisnal D (2007) The definitive guide to the Xen hypervisor. Prentice-Hall, New JerseyGoogle Scholar
  8. 8.
    Fahringer T, Prodan R, Duan R, Nerieri F, Podlipnig S, Qin J, Siddiqui M, Truong HL, Villazón A, Wieczorek M (2005, November 13–14) Askalon: a grid application development and computing environment. In proceedings of the 6th IEEE/ACM international conference on grid computing (GRID 2005). IEEE, Seattle, Washington DC, pp 122–131Google Scholar
  9. 9.
    Fahringer T, Qin J, Hainzer S (2005) Specification of grid workflow applications with agwl: an abstract grid workflow language. In CCGRID. IEEE Computer Society, pp 676–685Google Scholar
  10. 10.
    Czajkowski K, Fitzgerald S, Foster I, Kesselman C (2001) Grid information services for distributed resource sharing. In 10th international symposium on high performance distributed computing. IEEE Computer Society PressGoogle Scholar
  11. 11.
    Ostermann S, Plankensteiner K, Prodan R, Fahringer T, Iosup A (2008) “Workflow monitoring and analysis tool for ASKALON”, in Grid and Services Evolution. Barcelona, Spain, pp 73–86Google Scholar
  12. 12.
    Amazon (2009) Elastic compute cloud (EC2). http://aws.amazon.com/ec2/. Accessed January 2009Google Scholar
  13. 13.
    GoGrid (2009) Cloud hosting: Instant windows and linux cloud servers. http://www.gogrid.com/. Accessed January 2009Google Scholar
  14. 14.
    “Elastichosts: Cloud hosting and cloud computing that’s flexible and easy to use. http://www.elastichosts.com/
  15. 15.
    Mosso (2009) The cloud, cloud computing, cloud hosting, cloud services @ mosso. http://www.mosso.com/. Accessed January 2009Google Scholar
  16. 16.
  17. 17.
    Keahey K, Freeman T, Lauret J, Olson D (2007) Virtual workspaces for scientific applications. In Scientific discovery through advanced computing. Boston, MAGoogle Scholar
  18. 18.
    Buyya R, Yeo CS, Venugopal S (2008, 25–27 Sept) Market-oriented cloud computing: Vision, hype, and reality for delivering it services as computing utilities. In 10th IEEE international conference on high performance computing and communications (HPCC 2008). IEEE, Dalian, China, pp 5–13Google Scholar
  19. 19.
    Agathon Group (2009) https://www.agathongroup.com/. Accessed January 2009
  20. 20.
    FlexiScale (2009) Utility computing on demand. http://flexiscale.com/. Accessed January 2009Google Scholar
  21. 21.
    tera (2009) Applogic - grid operating system for web applications. http://www.3tera.com/AppLogic/. Accessed January 2009Google Scholar
  22. 22.
    Novotny J, Tuecke S, Welch V (2001) An online credential repository for the Grid: MyProxy. In proceedings of the tenth international symposium on high performance distributed computing (HPDC-10), IEEE Computer Society PressGoogle Scholar
  23. 23.
    von Laszewski G, Foster I, Gawor J (2000) CoG kits: a bridge between commodity distributed computing and high-performance grids. In Java Grande Conference. ACM Press, pp 97–106Google Scholar
  24. 24.
    Blaha P, Schwarz K, Luitz J (2001) WIEN2k, a full potential linearized augmented plane wave package for calculating crystal properties. TU Wien ISBN 3-9501031-1-2, 2001Google Scholar
  25. 25.
    Volkert J (2006, July 6–9) Austrian grid: Overview on the project with focus on parallel applications. In 5th international symposium on parallel and distributed computing (ISPDC 2006). IEEE Computer Society, Timisoara, Romania, p 14Google Scholar
  26. 26.
    Dongarra JJ, Luszczek P, Petitet A (2003) The LINPACK benchmark: past, present and future. Concurr Comput Prac Exp 15(9):803–820CrossRefGoogle Scholar
  27. 27.
    Gropp W, Lusk E, Ashton D, Buntinas D, Butler R, Chan A, Ross R, Thakur R, Toonen B (2005) Mpich2 user’s guide, version 1.0.3, Mathematics and computer science division, Argonne national laboratory. Technical Report. http://www-unix.mcs.anl.gov/mpi/mpich/ Google Scholar
  28. 28.
    Rehr JJ, Gardner JP, Prange M, Svec L, Vila F (2009) Scientific computing in the cloud. Computing Research Repository vol. abs/0901.0029, 2009Google Scholar
  29. 29.
    Yigitbasi N, Iosup A, Ostermann S, Epema D (2009) C-meter: A framework for performance analysis of computing clouds. In International Workshop on Cloud Computing (Cloud 2009)Google Scholar
  30. 30.
    Calheiros RN, Ranjan R, Rose CAFD, Buyya R (2009) Cloudsim: a novel framework for modeling and simulation of cloud computing infrastructures and services. Computing Research Repository, vol. abs/0903.2525, 2009Google Scholar

Copyright information

© Springer London 2010

Authors and Affiliations

  1. 1.Institute of Computer ScienceUniversity of InnsbruckInnsbruckAustria

Personalised recommendations