Audition of Web Services for Testing Conformance to Open Specified Protocols

  • Antonia Bertolino
  • Lars Frantzen
  • Andrea Polini
  • Jan Tretmans
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3938)


A Web Service (WS) is a type of component specifically conceived for distributed machine-to-machine interaction. Interoperability between WSs involves both data and messages exchanged and protocols of usage, and is pursued via the establishment of standard specifications to which service providers must conform. In previous work we have envisaged a framework for WS testing. Within this framework, this paper focuses on how the intended protocol of access for a standard service could be specified, and especially on how the conformance of a service instance to this specified protocol can then be tested. We propose to augment the WSDL description with a UML2.0 Protocol State Machine (PSM) diagram. The PSM is intended to express how, and under which conditions, the service provided by a component through its ports and interfaces can be accessed by a client. We then propose to translate the PSM to a Symbolic Transition System, to which existing formal testing theory and tools can be readily applied for conformance evaluation. A simple example illustrates the approach and highlights the peculiar challenges raised by WS conformance testing.


Label Transition System Simple Object Access Protocol Conformance Testing State Space Explosion Test Generation Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alonso, G., Casati, F., Kuno, H., Machiraju, V.: Web Services – Concepts, Architectures and Applications. Springer, Heidelberg (2004)zbMATHGoogle Scholar
  2. 2.
    Belinfante, A., Feenstra, J., de Vries, R.G., Tretmans, J., Goga, N., Feijs, L., Mauw, S., Heerink, L.: Formal test automation: A simple experiment. In: Csopaki, G., Dibuz, S., Tarnay, K. (eds.) 12th Int. Workshop on Testing of Communicating Systems, pp. 179–196. Kluwer Academic Publishers, Dordrecht (1999)CrossRefGoogle Scholar
  3. 3.
    Bertolino, A.: Knowledge area description of software testing. In: Guide to the Software Engineering Body of Knowledge SWEBOK. IEEE Computer Society, Los Alamitos (2000)Google Scholar
  4. 4.
    Bertolino, A., Polini, A.: The audition framework for testing web services interoperability. In: Proceedings of the 31st EUROMICRO International Conference on Software Engineering and Advanced Applications, Porto, Portugal, August 30th - September 3rd, 2005, pp. 134–142 (2005)Google Scholar
  5. 5.
    Booth, D., et al.: Web Services Architecture (February 2004),
  6. 6.
    Brinksma, E., Tretmans, J.: Testing transition systems: An annotated bibliography. In: Cassez, F., Jard, C., Rozoy, B., Dermot, M. (eds.) MOVEP 2000. LNCS, vol. 2067, pp. 187–195. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  7. 7.
    Briones, L.B., Brinksma, E.: A test generation framework for quiescent real-time systems. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 64–78. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  8. 8.
    Broy, M., Jonsson, B., Katoen, J.-P., Leucker, M., Pretschner, A. (eds.): Model-Based Testing of Reactive Systems. LNCS, vol. 3472. Springer, Heidelberg (2005)zbMATHGoogle Scholar
  9. 9.
    Christensen, E., et al.: Web Service Definition Language (WSDL) ver. 1.1 (March 2001)
  10. 10.
    Clement, L., et al.: Universal Description Discovery & Integration (UDDI) ver. 3.0 (October 2004),
  11. 11.
    Eriksson, H.E., et al.: UML 2 Toolkit. John Wiley and Sons, Chichester (2004)Google Scholar
  12. 12.
    Bellinger, K., et al.: WS-I - basic profile, ver. 1.1 (August 2004),
  13. 13.
    Foster, H., et al.: Model-based verification of web services compositions. In: Proc. ASE 2003, Montreal, Canada, October 6-10, 2003, pp. 152–161 (2003)Google Scholar
  14. 14.
    Frantzen, L., Tretmans, J., Willemse, T.A.C.: Test generation based on symbolic specifications. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 1–15. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  15. 15.
    Fu, X., Bultan, T., Su, J.: Analysis of interacting BPEL web services. In: Proc. of WWW 2004, New York, USA, May 17-22, 2004 (2004)Google Scholar
  16. 16.
    Garlan, D., Allen, R., Ockerbloom, J.: Architectural mismatch or why it’s hard to build system out of existing parts. In: Proceedings 17th International Conference on Software Enginneering, pp. 179–185 (April 1995)Google Scholar
  17. 17.
    Gross, H.G., Schieferdecker, I., Din, G.: Testing Commercial-off-the-Shelf Components and Systems. In: Modeling and Implementation of Built-In Contract Tests. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  18. 18.
    Gudgin, M., et al.: Simple Object Access Protocol (SOAP) ver. 1.2 (June 2003),
  19. 19.
    Heckel, R., Lohman, M.: Towards contract-based testing of web services. In: Proc. TACOS, 2004. Electr. Notes Theor. Comput. Sci., vol. 116, pp. 145–156 (2004)Google Scholar
  20. 20.
    Heckel, R., Mariani, L.: Automatic conformance testing of web services. In: Cerioli, M. (ed.) FASE 2005. LNCS, vol. 3442, pp. 34–48. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  21. 21.
    Jard, C., Jéron, T.: TGV: theory, principles and algorithms. In: IDPT 2002, Society for Design and Process Science, Pasadena, California, USA (June 2002)Google Scholar
  22. 22.
    Meyer, B.: Applying design by contract. IEEE Computer 25(10), 40–51 (1992)CrossRefGoogle Scholar
  23. 23.
    Object Management Group. UML 2.0 Superstructure Specification, ptc/03-08-02 edition. Adopted SpecificationGoogle Scholar
  24. 24.
    Orso, A., Harrold, M.J., Rosenblum, D.S.: Component metadata for software engineering tasks. In: Emmerich, W., Tai, S. (eds.) EDO 2000. LNCS, vol. 1999, pp. 129–144. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  25. 25.
    Polini, A., Bertolino, A.: A User-Oriented Framework for Component Deployment Testing. In: Testing Commercial-off-the-Shelf Components and Systems. Springer, Heidelberg (2005)Google Scholar
  26. 26.
    Tretmans, J.: Test Generation with Inputs, Outputs and Repetitive Quiescence. Software – Concepts and Tools 17(3), 103–120 (1996)zbMATHGoogle Scholar
  27. 27.
    Tsai, W.T., et al.: Scenario-based web service testing with distributed agents. IEICE Transaction on Information and System E86-D(10), 2130–2144 (2003)Google Scholar
  28. 28.
    Tsai, W.T., et al.: Verification of web services using an enhanced UDDI server. In: Proc. of WORDS 2003, Guadalajara, Mexico, January 15-17, 2003, pp. 131–138 (2003)Google Scholar
  29. 29.
    XML Metadata Interchange (XMI) Specification ver. 2.0 (May 2003),

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Antonia Bertolino
    • 1
  • Lars Frantzen
    • 2
  • Andrea Polini
    • 1
  • Jan Tretmans
    • 2
  1. 1.Istituto di Scienza e Tecnologie della Informazione “Alessandro Faedo”, Consiglio Nazionale delle RicerchePisaItaly
  2. 2.Institute for Computing and Information SciencesRadboud University NijmegenThe Netherlands

Personalised recommendations