Skip to main content

Web Service Composition Using Markov Decision Processes

  • Conference paper
Book cover Advances in Web-Age Information Management (WAIM 2005)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3739))

Included in the following conference series:

Abstract

This paper discusses a method for dynamic web service composition, which is based on Markov Decision Processes (MDP). It is defined on the base of QoS description and addresses the issue of selecting web services for the purpose of their composition. Web service composition patterns including sequential, conditional, parallel and iterative are modeled in MDP. Two computation algorithms for MDP are introduced and implemented. One is backward recursive iteration and the other is forward iteration, both called Value Iteration. Experiments are conducted to evaluate the performance of MDP methods for service composition. Experimental results show that the methods are efficient. The effect of average failure probability of service invocation on performance is also examined in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hull, R., Benedikt, M., Christophides, V., Su, J.: E-services: A look behind the curtain. In: Proc. ACM Symp. on Principles of Database Systems (2003)

    Google Scholar 

  2. Tsalgatidou, A., Pilioura, T.: An Overview of Standards and Related Technology in Web Services. Distributed and Parallel Databases 12, 125–162 (2002)

    Article  Google Scholar 

  3. Doshi, P., Goodwin, R., Akkiraju, R., Verma, K.: Dynamic Workflow Composition using Markov Decision Processes. In: Proceedings of the IEEE International Conference on Web Services (ICWS 2004) (2004)

    Google Scholar 

  4. Ke, L.: Applied Markov Decision Processes, p. 21. Tsinghua Press, Beijing (2004) (in Chinese)

    Google Scholar 

  5. Bellman, R.E.: Dynamic Programming. Princeton University Press, Princeton (1957)

    MATH  Google Scholar 

  6. Business Process Execution Language for Web Services, version 1.1, http://www.ibm.com/developerworks/library/ws-bpel/

  7. WS Choreography Model Overview (2004), http://www.w3.org/TR/ws-chor-model/

  8. OWL Services Coalition. OWL-S: Semantic markup for web services (November 2003)

    Google Scholar 

  9. W3C, Web Services Description Language (WSDL) Version 2.0, W3C Working Draft (March 2003), see http://www.w3.org/TR/wsdl20/

  10. van der Aalst, W.M.P., Dumas, M., ter Hofstede, H.M.: Web Service Composition Languages: Old Wine in New Bottles? In: Chroust, G., Hofer, C. (eds.) Proceedings of the 29th EUROMICRO Conference“New Waves in System Architecture” (EUROMICRO 2003), pp. 298–305. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  11. Canfora, G., Di Penta, M., Esposito, R., Villani, M.L.: A Lightweight Approach for QoS-Aware Service Composition. In: 2nd International Conference on Service Oriented Computing (ICSOC), p. 63. ACM Press, New York (2004)

    Google Scholar 

  12. Zeng, L., Benatallah, B., Ngu, A.H.H., Dumas, M., Kalagnanam, J., Chang, H.: QoS-Aware Middleware for Web Services Composition. IEEE transactions on Software Engineering 30(5), 311–327 (2004)

    Article  Google Scholar 

  13. White, D.J.: Markov Decision Processes, pp. 1–96. Wiley, Chichester (1993)

    MATH  Google Scholar 

  14. Hu, Q., Liu, J.: An introduction to Markov Decision Processes. Xidian University Press (2000) (in Chinese)

    Google Scholar 

  15. Hull, R., Su, J.: Tools for Design of Composite Web Services (ppt), http://www.cs.ucsb.edu/~su/tutorials/sigmod2004.htm

  16. Deutsch, A., Sui, L., Vianu, V.: Specification and verification of data-driven web services. In: Proc. ACM Symp. on Principles of Database Systems (2004)

    Google Scholar 

  17. Peng, D., Yuan, Y., Yue, K., Wang, X., Zhou, A.: Capacity Planning for Composite Web Services Using Queueing Network-Based Models. In: Li, Q., Wang, G., Feng, L. (eds.) WAIM 2004. LNCS, vol. 3129, pp. 439–448. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  18. Menasc, D.A.: Composing Web Services: A QoS View. IEEE Internet Computing 8(6), 88–90 (2004)

    Article  Google Scholar 

  19. Menasc, D.A., Ruan, H., Gomaa, H.: A Framework for QoS-Aware Software Components. In: Proc. 2004 ACM Workshop on Software and Performance, pp. 186–196. ACM Press, New York (2004)

    Google Scholar 

  20. Ran, S.: A Model for Web Services Discovery With QoS. ACM SIGecom Exchanges 4(1) (March 2003)

    Google Scholar 

  21. QoS for Web Services: Requirements and Possible Approaches, Hyderabad, August 4-6 (2004)

    Google Scholar 

  22. Ghandeharizadeh, S., et al.: Proteus: A System for dynamically composing and Intelligently Executing Web Services. In: ICWS 2003 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gao, A., Yang, D., Tang, S., Zhang, M. (2005). Web Service Composition Using Markov Decision Processes. In: Fan, W., Wu, Z., Yang, J. (eds) Advances in Web-Age Information Management. WAIM 2005. Lecture Notes in Computer Science, vol 3739. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11563952_28

Download citation

  • DOI: https://doi.org/10.1007/11563952_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29227-2

  • Online ISBN: 978-3-540-32087-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics