Skip to main content

Vertical Load Distribution for Cloud Computing via Multiple Implementation Options

  • Chapter
  • First Online:
Handbook of Cloud Computing
  • 6937 Accesses

Abstract

Cloud computing looks to deliver software as a provisioned service to end users, but the underlying infrastructure must be sufficiently scalable and robust. In our work, we focus on large-scale enterprise cloud systems and examine how enterprises may use a service-oriented architecture (SOA) to provide a streamlined interface to their business processes. To scale up the business processes, each SOA tier usually deploys multiple servers for load distribution and fault tolerance, a scenario which we term horizontal load distribution. One limitation of this approach is that load cannot be distributed further when all servers in the same tier are loaded. In complex multi-tiered SOA systems, a single business process may actually be implemented by multiple different computation pathways among the tiers, each with different components, in order to provide resilience and scalability. Such multiple implementation options gives opportunities for vertical load distribution across tiers. In this chapter, we look at a novel request routing framework for SOA-based enterprise computing with multiple implementation options that takes into account the options of both horizontal and vertical load distribution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bent, R., & Van Hentenryck, P. (2004). Regrets Only! Online stochastic optimization under time constraints. Nineteenth National Conference on Artificial Intelligence, San Jose, CA.

    Google Scholar 

  • Buco, M. J., Chang, R. N., Luan, L. Z., Ward, C., Wolf, J. L., Yu, P. S., et al. (2003). Managing ebusiness on demand sla contracts in business terms using the cross-sla execution manager sam. ISADS, Washington, DC, 157–164.

    Google Scholar 

  • Business Process Execution Language for Web Services (Version 1.1), (2005). www-128.ibm.com/developerworks/library/ws-bpel/.

  • Casati, F., Ilnicki, S., Jin, L., Krishnamoorthy, V., & Shan, M.-C. (2000). Adaptive and Dynamic Service Composition in eFlow. Proceedings of CAISE, Stockholm, Sweden, 13–31.

    Google Scholar 

  • Cisco. Ace application-level load balancer. http://www.cisco.com/en/US/products/ps6906/. Accessed July 29, 2010.

  • Cisco. Scalable Content Switching. http://www.cisco.com/en/US/products/hw/contnetw/ps792/products_white_paper09186a0080136856.shtml. Accessed July 29, 2010.

  • Cloud Computing (2009). Clash of the clouds. The Economist.

    Google Scholar 

  • Costa, L., & Oliveira, P. (2001). Evolutionary algorithms approach to the solution of mixed integer nonlinear programming problems. Computers and Chemical Engineering, 25(2–3), 257–266.

    Google Scholar 

  • Davis, L. (1985). Job shop scheduling with genetic algorithms. Proceedings of the International Conference on Genetic Algorithms, Pittsburgh, PA.

    Google Scholar 

  • DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., & Vogels, W. (2007). Dynamo: Amazon’s highly available key-value store. Proceedings of SOSP, Washington D.C., 205–220.

    Google Scholar 

  • Dewri, R., Ray, I., Ray, I., & Whitley, D. (2008). Optimizing on-demand data broadcast scheduling in pervasive environments. Proceedings of EDBT, Nantes, France, 559–569.

    Google Scholar 

  • Dikaiakos, M., Pallis, G., Katsaros, D., Mehra, P., & Vakali, A. (2009). Cloud computing: Distributed internet computing for it and scientific research. IEEE Internet Computing, 13(5), 10–13.

    Article  Google Scholar 

  • F5 Networks. Big-ip application-level load balancer. http://www.f5.com/products/big-ip/. Accessed July 29, 2010.

  • Goldberg, D. (1989). Genetic algorithms in searth, optimization, and machine learning. Dordrecht: Kluwer.

    Google Scholar 

  • Gu, X., Nahrstedt, K., Chang, R. N., & Ward, C. (2003). Qos-assured service composition in managed service overlay networks. Proceedings of ICDCS, Providence, Rhode Island, USA, 194–203.

    Google Scholar 

  • Holland, J. (1992). Adaptation in natural and artificial systems. Cambridge, MA: MIT Press.

    Google Scholar 

  • Jin, J., & Nahrstedt, K. (2004). On exploring performance optimisations in web service composition. Proceedings of Middleware, Toronto, Canada.

    Google Scholar 

  • Josephraj, J. (2007). Web services choreography in practice. www-128.ibm.com/developerworks/library/ws-choreography. Accessed July 29, 2010.

  • Lima, R., Francois, G., Srinivasan, B., & Salcedo, R. (2004). Dynamic optimization of batch emulsion polymerization using MSIMPSA, a simulated-annealing-based algorithm. Industrial and Engineering Chemistry Research, 43(24), 7796–7806.

    Google Scholar 

  • Oliveira, R., & Salcedo, R. (2005). Benchmark testing of simulated annealing, adaptive random search and genetic algorithms for the global optimization of bioprocesses. International Conference on Adaptive and Natural Computing Algorithms, Coimbra, Portugal.

    Google Scholar 

  • Phan, T., & Li, W.-S. (2008a). Dynamic materialization of query views for data warehouse workloads. Proceedings of the International Conference on Data Engineering, Long Beach, CA.

    Google Scholar 

  • Phan, T., & Li, W.-S. (2008b). Load distribution of analytical query workloads for database cluster architectures. Proceedings of EDBT, Nantes, France, 169–180.

    Google Scholar 

  • Ponnekanti, S., & Fox, A. (2004). Interoperability among Independently Evolving Web Services. Proceedings of Middleware, Toronto, Canada.

    Google Scholar 

  • Shankar, M., De Miguel, M., & Liu, J. W.-S. (2004). An end-to-end qos management architecture. Proceedings of the Fifth IEEE Real Time Technology and Applications Symposium, Vancouver, British Columbia, Canada, p. 176.

    Google Scholar 

  • Soundararajan, G., Manassiev, K., Chen, J., Goel, A., & Amza, C. (2005). Back-end databases in shared dynamic content server clusters. Proceedings of ICAC, Dublin, Ireland.

    Google Scholar 

  • Tang, C., Chang, R. N., & So, E. (2006). A distributed service management infrastructure for enterprise data centers based on peer-to-peer technology. IEEE SCC, Chicago, IL, 52–59.

    Google Scholar 

  • Urgaonkar, B., Shenoy, P., Chandra, A., & Goyal, P. (2005). Dynamic provisioning of multi-tier internet applications. Proceedings of ICAC, Seattle, WA.

    Google Scholar 

  • Van Hentenryck, P., & Bent, R. (2006). Online stochastic combinatorial optimization. Cambridge, MA: MIT Press.

    Google Scholar 

  • Ward, C., Buco, M. J., Chang, R. N., Luan, L. Z., So, E., & Tang, C. (2005). Fresco: A web services based framework for configuring extensible sla management systems. ICWS, Sunshine Coast, Australia 237–245.

    Google Scholar 

  • Yu, T., & Lin, K.-J. (2005a). Adaptive algorithms for finding replacement services in autonomic distributed business processes. Proceedings of the 7th International Symposium on Autonomous Decentralized Systems, Chengdu, China.

    Google Scholar 

  • Yu, T., & Lin, K.-J. (2005b). Service selection algorithms for web services with end-to-end qos constraints. Information Systems and E-Business Management, 3(2), 103–126.

    Article  MathSciNet  Google Scholar 

  • Yu, T., & Lin, K.-J. (2006). Qcws: An implementation of qos-capable multimedia web services. Multimedia Tools and Applications, 30(2), 165–187.

    Article  Google Scholar 

  • Yu, T., Zhang, Y., & Lin, K.-J. (2007). Efficient algorithms for web services selection with end-to-end qos constraints. ACM Transactions on the Web (TWEB), 1(1). http://portal.acm.org/citation.cfm?id=1232722.1232728. Accessed July 29, 2010.

  • Zeng, L., Benatallah, B., Dumas, M., Kalagnanam, J., & Sheng, Q. (2003). quality driven web services composition. Proceedings of WWW, Helsinki, Finland.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thomas Phan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Phan, T., Li, WS. (2010). Vertical Load Distribution for Cloud Computing via Multiple Implementation Options. In: Furht, B., Escalante, A. (eds) Handbook of Cloud Computing. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-6524-0_12

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-6524-0_12

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4419-6523-3

  • Online ISBN: 978-1-4419-6524-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics