Skip to main content

Tools and Technologies for Building Clouds

Part of the Computer Communications and Networks book series (CCN)

Abstract

With cloud computing growing in popularity, tools and technologies are emerging to build, access, manage, and maintain the clouds. These tools need to manage the huge number of operations within a cloud transparently and without service interruptions. Cloud computing promises lower costs, faster implementation, and more flexibility using mixtures of technologies, and the associated tools are critical for achieving this.

In this chapter, we survey several state-of-the-art techniques for building clouds, starting with virtualization technology. We briefly introduce virtual machines (VMs) and their main features. Then, we introduce the main tools to manage VMs (hypervisors and virtual infrastructure managers) as well as the major technologies used to manage VMs in a public cloud. We then present MapReduce, a powerful model that makes it easier to write programs that take advantage of the power of cloud computing. We conclude by examining four web services tools and technologies that are built for cloud computing.

Keywords

  • Cloud Computing
  • Virtual Machine
  • Cloud Provider
  • Simple Object Access Protocol
  • Virtualization Technology

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-1-84996-241-4_1
  • Chapter length: 18 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   149.00
Price excludes VAT (USA)
  • ISBN: 978-1-84996-241-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   199.00
Price excludes VAT (USA)
Fig. 1.1
Fig. 1.2
Fig. 1.3
Fig. 1.4

References

  1. APPRIO Homepage (2009) http://www.appirio.com/

  2. Force.com Homepage (2009) http://www.salesforce.com/platform/

  3. Amazon Web Services (2009) http://aws.amazon.com/

  4. Barroso LA, Urs Hölzle U (2009) The datacenter as a computer: an introduction to the design of warehouse-scale machines. Morgan & Claypool, USA

    Google Scholar 

  5. ADO.NET Data Service (formally Astroia) (2009) http://msdn.microsoft.com/en-us/data/bb931106.aspx

  6. Google AppEngine (2009) http://code.google.com/appengine/

  7. Amazon Elastic Cloud Computing (2009) http://aws.amazon.com/ec2/

  8. Enomaly Elastic Computing (2009) http://www.enomaly.com/

  9. Open Nubela Homepage (2009) http://www.opennebula.org/

  10. Rightscale Homepage (2009) http://www.rightscale.com/

  11. Elastra Manage ComplexITy Homepage (2009) http://www.elastra.com/

  12. Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    CrossRef  Google Scholar 

  13. Patterson DA (2008) Technical perspective: the data center is the computer. Commun ACM 51(1):105

    Google Scholar 

  14. Vmware (2009) http://www.vmware.com/virtualization/history.html

  15. Goldberg RP (1974) Survey of virtual machine research. IEEE Comput Mag 7(6):34–45

    Google Scholar 

  16. Waldspurger CA (December 2002) Memory resource management in VMware ESX server. In: Proceedings of the 5th symposium on operating systems design and implementation (OSDI ’02), Boston, MA

    Google Scholar 

  17. Fraser K, Hand S, Neugebauer R, Pratt I, Warfield A, Williamson M (2004) Safe hardware access with the Xen virtual machine monitor. In: OASIS ASPLOS 2004 workshop

    Google Scholar 

  18. Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt L, Warfield A (2005) Live migration of virtual machines. In: Proceedings of the 2nd symposium on networked systems design and implementation (NSDI ’05), Boston, MA

    Google Scholar 

  19. Garfinkel T, Pfaff B, Chow J, Rosenblum M, Boneh D (2003) Terra: a virtual machine-based platform for trusted computing. In: Proceedings of the 19th ACM symposium on operating systems principles (SOSP ’03), Bolton Landing (Lake George), New York

    Google Scholar 

  20. Bressoud TC, Schneider FB (1995) Hypervisor based fault tolerance. In: Proceedings of the fifteenth ACM symposium on operating systems principles, ACM Press, pp 1–11

    Google Scholar 

  21. Petrini F, Kerbyson DJ, Pakin S (2003) The case of the missing supercomputer performance: achieving optimal performance on the 8,192 processors of ASCI Q. In: Proceedings of SC ’03, Washington, DC, USA

    Google Scholar 

  22. Koch K (2002) How does ASCI actually complete multi-month 1000-processor milestone simulations? In: Proceedings of the conference on high speed computing

    Google Scholar 

  23. Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: the Proceedings of the grid computing environments workshop

    Google Scholar 

  24. Nanda S, Chiueh T (2005) A survey on virtualization technologies, RPE Report, February. www.ecsl.cs.sunysb.edu/tr/TR179.pdf

  25. Virtual Machine (Wikipedia) (2009) http://en.wikipedia.org/wiki/Virtual_machine

  26. IBM white paper (2009) Seeding the Clouds: Key Infrastructure Elements for Cloud Computing. ftp://ftp.software.ibm.com/common/ssi/sa/wh/n/oiw03022usen/OIW03022USEN.PDF

  27. VMware – Virtual Infrastructure Software (2009) http://www.vmware.com.

  28. Xen Homepage (2009) http://www.xen.org/.

  29. Kernel-based Virtual Machine (2009) http://kvm.qumranet.com.

  30. Microsoft Hyper-V (2009) http://www.microsoft.com/hyper-v-server/en/us/default.aspx

  31. Pratt I, Warfield A, Barham P, Neugebauer R (2003) Xen and the art of virtualization. In Proceedings of the 19th ACM symposium on operating systems principles (SOSP ’03), Bolton Landing (Lake George), New York

    Google Scholar 

  32. Whitaker A, Shaw M, Gribble SD (2002) Scale and performance in the Denali isolation kernel. In: Proceedings of the 5th symposium on operating systems design and implementation (OSDI’02), Boston, MA

    Google Scholar 

  33. MSDN Architecture Center, Mapping Applications to the Cloud (2009) http://msdn.microsoft.com/en-us/library/dd430340.aspx

  34. Comparison of platform virtual machines (Wikipedia) (2009) http://en.wikipedia.org/wiki/Comparison_of_platform_virtual_machines

  35. Eucalyptus system Homepage (2009) http://www.eucalyptus.com/

  36. Nimbus Homepage (2009) http://workspace.globus.org/

  37. Elastic Hosts Homepage (2009) http://www.elastichosts.com/

  38. McNett M, Gupta D, Vahdat A, Voelker GM (2007) Usher: an extensible framework for managing clusters of virtual machines. 21st Large installation system administration conference

    Google Scholar 

  39. Shi XH, Tan H, Wu S, Jin H (2008) VNIX: managing virtual machines on clusters, pp 155–162. Japan-China joint workshop on frontier of computer science and technology

    Google Scholar 

  40. OGF Open Cloud Computing Interface Working Group (2009) http://www.occi-wg.org/doku.php

  41. VMan Initiative (2009) http://www.dmtf.org/initiatives/vman_initiative/

  42. libvirt: The virtualization API (2009) http://libvirt.org/

  43. RightScale – Testimonials (2009) http://www.rightscale.com/customers/

  44. Kaavo Homepage (2009) http://www.kaavo.com/home

  45. Kaavo – Testimonials (2009) http://www.kaavo.com/testimonials

  46. CohesiveFT Homepage (2009) http://www.cohesiveft.com/

  47. Ghemawat S, Gobioff H, Leung ST (2003) The google file system. In: the proceedings of the 19th ACM symposium on operating systems principles, Lake George, New York

    Google Scholar 

  48. Hadoop (2009) http://lucene.apache.org/

  49. Yahoo! (2009) Yahoo! Developer Network. http://developer.yahoo.com/blogs/hadoop/2008/02/yahoo-worlds-largest-production-hadoop.html. Accessed September 2009

  50. Hadoop Credits Page (2009) http://hadoop.apache.org/core/credits.html. Accessed September 2009

  51. CloudStore (Formely Kosmos File System) (2009) http://kosmosfs.sourceforge.net/

  52. NET Remoting, http://en.wikipedia.org/wiki/.NET_Remoting

  53. Java RMI, http://en.wikipedia.org/wiki/Java_RMI

  54. J2EE, http://en.wikipedia.org/wiki/J2EE

  55. Service Oriented Architecture (Wikipedia) (2009) http://en.wikipedia.org/wiki/Service-oriented_architecture

  56. Service-architecture – Service-oriented architecture (SOA) definition (2009) http://www.service-architecture.com/web-services/articles/service-oriented_architecture_soa_definition.html

  57. WSRF (2009) http://www.oasis-open.org/committees/wsrf/

  58. WS-Security (2009) http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wss

  59. WS-Policy (2009) http://www.w3.org/Submission/WS-Policy/

  60. Goth G (2004) Critics say web services need a REST. IEEE Distribut Syst Online 5(12): 1–1

    CrossRef  Google Scholar 

  61. Vinoski S (2008) RESTful web services development checklist. IEEE Internet Comput 12(6):94–96

    CrossRef  Google Scholar 

  62. Vinoski S ((2007) REST eye for the SOA guy. IEEE Internet Comput 11(1):82–84

    CrossRef  Google Scholar 

  63. Mashup (web application hybrid), http://en.wikipedia.org/wiki/Mashup_(web_application_hybrid)

  64. Webmashup.com blog, http://www.webmashup.com/blog/category/learn/ (accessed 1 October 2009)

  65. Google Mashup Editor (2009) http://en.wikipedia.org/wiki/Google_Mashup_Editor

  66. Mozilla Ubiquity (2009) http://ubiquity.mozilla.com/

Download references

Acknowledgments

This work is supported by National 973 Key Basic Research Program under grant No.2007CB310900, NSFC under grants No.60673174 and No.60973037, Program for New Century Excellent Talents in University under Grant NCET-07-0334, Information Technology Foundation of MoE and Intel under grant MoE-INTEL-09-03, and National High-Tech R&D Plan of China under grant No.2006AA01A115.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hai Jin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2010 Springer London

About this chapter

Cite this chapter

Jin, H. et al. (2010). Tools and Technologies for Building Clouds. In: Antonopoulos, N., Gillam, L. (eds) Cloud Computing. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84996-241-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-241-4_1

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-240-7

  • Online ISBN: 978-1-84996-241-4

  • eBook Packages: Computer ScienceComputer Science (R0)