Model-Based Testing for Composite Web Services in Cloud Brokerage Scenarios

  • Mariam Kiran
  • Anthony J. H. SimonsEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 508)


Cloud brokerage is an enabling technology allowing various services to be merged together for providing optimum quality of service for the end-users. Within this collection of composed services, testing is a challenging task which brokers have to take on to ensure quality of service. Most Software-as-a-Service (SaaS) testing has focused on high-level test generation from the functional specification of individual services, with little research into how to achieve sufficient test coverage of composite services. This paper explores the use of model-based testing to achieve testing of composite services, when two individual web services are tested and combined. Two example web services – a login service and a simple shopping service – are combined to give a more realistic shopping cart service. This paper focuses on the test coverage required for testing the component services individually and their composition. The paper highlights the problems of service composition testing, requiring a reworking of the combined specification and regeneration of the tests, rather than a simple composition of the test suites; and concludes by arguing that more work needs to be done in this area.


Cloud Service Test Suite Service Composition Component Service Composite Service 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 328392, the Broker@Cloud project (


  1. 1.
    Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as 5th utility. Future Gener. Comput. Syst. 25, 599–616 (2008)CrossRefGoogle Scholar
  2. 2.
    Khan, A.U., Kiran, M., Oriol, M., Jiang, M., Djemame, K.: Security risks and their management in cloud computing. In: CloudCom, pp. 121–128 (2012)Google Scholar
  3. 3.
    Kiran, M., Jiang, D., Armstrong, K., Djemame, K.: Towards a service life cycle-based methodology for risk assessment in cloud computing. In: Cloud and Green Computing (2011)Google Scholar
  4. 4.
    Plummer, D.C., Lheureux, B.J., Karamouzis, F.: Defining Cloud Services Brokerage: Taking Intermediation to the Next Level. Report ID G00206187, Gartner Inc. (2010)Google Scholar
  5. 5.
    Bell, M.: Introduction to service-oriented modeling. In: Bell, M. (ed.) Service-Oriented Modeling: Service Analysis, Design, and Architecture, p. 3. Wiley, Hoboken (2008). ISBN 978-0-470-14111-3Google Scholar
  6. 6.
    Arcitura Education Inc.: Service Orientation. (2012)
  7. 7.
    Norton, D., Feiman, J., McDonald, N., Pezzini, M., Natis, Y., Sholler, D., Heiden, G., Karamouzis, F., Young, A., James, G.A., Knipp, E., Duggan, J., Murphy, T., Valdes, R., Blechar, M., Driver, M., Young, G., Vining, J., Knox, R., Feinberg, D., Hart, T., Patrick, C., Forsman, J., Basso, M., Simpson, R., Adachi, Y., Clark, W., King, M., Hill, J., Gootzit, D., Bradley, A., Kenney, L., Stang, D.: Hype Cycle for Application Development, Gartner (2009)Google Scholar
  8. 8.
    Mei, H., Zhang, L.: A framework for testing web services and its supporting tool. In: Proceedings of IEEE International Workshop on Service-Oriented System Engineering, pp. 199–206. Computer Society (2005)Google Scholar
  9. 9.
    Marchetto, A., Tonella, P., Ricca, F.: State-based testing of Ajax web applications. In: Proceedings of the International Conference on Software Testing, Verification and Validation, pp. 121–130. IEEE Computer Society (2008). doi: 10.1109/ICST.2008.22
  10. 10.
    Mesbah, A., Roest, D.: Invariant-based automatic testing of modern web applications. IEEE Trans. Softw. Eng. 38(1), 35–53 (2012)CrossRefGoogle Scholar
  11. 11.
    Bozkurt, M., Harman, M., Hassoun, Y.: Testing & verification in service-oriented architecture: a survey. Softw. Test. Verification Reliab. (2009). doi: 10.1002/000 Google Scholar
  12. 12.
    Web Services Architecture (W3C Working Group)Google Scholar
  13. 13.
    Hull, R., Su, J.: Tools for Design of Composite Web Services, Presented Version, 17 June 2004.
  14. 14.
    Mealy, G.H.: A method to synthesizing sequential circuits. Bell Syst. Tech. J. 34, 1045–1079 (1955)CrossRefMathSciNetGoogle Scholar
  15. 15.
    Klusch, M., Gerber, A.: Evaluation of Service Composition Planning with OWLS-XPlan.
  16. 16.
    Norton, B., Foster, S., Hughes, A.: A Compositional Operational Semantics for OWL-S.
  17. 17.
    Kiran, M., Friesen, A., Simons, A.J., Schwach, W.K.: Model-based testing in cloud brokerage scenarios. In: Lomuscio, A.R., Nepal, S., Patrizi, F., Benatallah, B., Brandić, I. (eds.) ICSOC 2013. LNCS, vol. 8377, pp. 192–208. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  18. 18.
    Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Morgan-Kaufmann, Burlington (2007)Google Scholar
  19. 19.
    Pretschner, A., Philipps, J.: 10 methodological issues in model-based testing. In: Broy, M., Jonsson, B., Katoen, J.-P., Leucker, M., Pretschner, A. (eds.) Model-Based Testing of Reactive Systems. LNCS, vol. 3472, pp. 281–291. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  20. 20.
    Holcombe, W.M.L., Ipate, F.: Correct Systems - Building a Business Process Solution. Applied Computing Series. Springer, Berlin, Heidelberg, New York (1998)zbMATHGoogle Scholar
  21. 21.
    Fu, X., Bultan, T., Su, J.: Analysis of interacting Bpel web services. In: Proceedings of the 13th International Conference on World Wide Web, pp. 621–630. ACM Press (2004)Google Scholar
  22. 22.
    Deutsch, S., Vianu, A.: Specification and Verification of Data Driven Web Services (2004)Google Scholar
  23. 23.
    Venkatraman, M., Singh, M.P.: Verifying compliance with commitment protocols. Auton. Agent. Multi-Agent Syst. 2, 217–236 (1999)CrossRefGoogle Scholar
  24. 24.
    Cao, T., Felix, P., Castanet, R., Berrada, I.: Online testing framework for web services. In: Proceedings 3rd International Conference on Software Testing, Verification and Validation, pp. 363–372. IEEE Computer Society (2010). doi: 10.1109/ICST.2010.11
  25. 25.
    Belli, F., Linschulte, M.: An Event-Based Approach, April 2009Google Scholar
  26. 26.
    Tsai, W.T., Chen, Y., Paul, R., Liao, N., Huang, H.: Cooperative and Group Testing in Verification of Dynamic Composite Web Services (2011)Google Scholar
  27. 27.
    Endo, A.T., Silveira, M.B., Macedo, E., Simao, R., de Oliveiray, F.M., Zorzo, A.F.: Using models to test web service-oriented applications: an experience report (2012)Google Scholar
  28. 28.
    Ipate, F.: Test selection for hierarchical and communicating finite state machines. Comput. J. 52(3), 334–347 (2009)CrossRefGoogle Scholar
  29. 29.
    Bertolino, A., Frantzen, L., Polini, A., Tretmans, J.: Audition of web services for testing conformance to open specified protocols. In: Reussner, R., Stafford, J.A., Ren, X.-M. (eds.) Architecting Systems with Trustworthy Components. LNCS, vol. 3938, pp. 1–25. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  30. 30.
    Simons, A.J.H.: Cloud Service Quality Control: Broker@Cloud Verification and Testing Tool Suite (2014).
  31. 31.
    Wu, B., Zhou, B., Xi, L.: Remote multi-robot monitoring and control system based on MMS and web services. Ind. Robot: Int. J. 34(3), 225–239 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.School of Electrical Engineering and Computer ScienceUniversity of BradfordBradfordUK
  2. 2.Department of Computer ScienceUniversity of SheffieldSheffieldUK

Personalised recommendations