Quality analysis of composed services through fault injection

  • Maria Grazia Fugini
  • Barbara PerniciEmail author
  • Filippo Ramoni


Web service composition can be adopted to develop information systems through integration of services to obtain complex composed services. While interfaces of services are known at composition time, the quality of a composed service may depend on the ability of its component services to react to unforeseen situations, such as data quality problems and service coordination problems. In this work, we propose an approach to analyze the quality of composed services using fault injection techniques, by inspecting the reaction of a composed process to injected faults; the aim is to assess the process quality in terms of fault monitoring and, more generally, fault tolerance capabilities. The component services are analyzed either as black-boxes, when only input and output messages are considered or as white-boxes, when data sources used by services are considered. A test bed is illustrated on a selected example, and results of extensive testing are discussed and framed into a process analysis methodology.


Web service analysis Information systems quality Process testing Complex composed services Fault injection 



This work has been partially supported by the WS-Diamond FET STREP project funded by the European Commission under IST FP6.


  1. Ballou, D., Wang, R., Pazer, H., & Tayi, G. (1998). Modelling information manufacturing systems to determine information product quality. Management Science, 4, 462–533.CrossRefGoogle Scholar
  2. Batini, C., & Scannapieco, M. (2006). Data quality. New York: Springer.Google Scholar
  3. Cappiello, C., Ficiaro, P., & Pernici, B. (2006). HIQM: A methodology for information quality monitoring, measurement, and improvement. In J. F. Roddick (Ed.), Advances in conceptual modeling-theory and practice ER 2006 Workshops BP-UML, CoMoGIS, COSS, ECDM, OIS, QoIS, SemWAT, Tucson, AZ, USA, November 6-9, 2006 (pp. 339–351). Heidelberg: Springer Berlin.Google Scholar
  4. Cappiello, C., Francalanci, C., & Pernici, B. (2004). Time-related factors of data quality in multichannel information systems. Journal of Management Information Systems, 20(3), 71–91.Google Scholar
  5. Carreira, J., & Silva, J. G. (1998). Why do some (weird) people inject faults? SIGSOFT. Software Enginneering Notes, 1, 42–43.CrossRefGoogle Scholar
  6. Console, L., & WS-Diamond Team (2007) WS-DIAMOND: An approach to web services DIAgnosability, MONitoring and Diagnosis. In eChallenges 2007, The Hague, The Netherlands, October 2007.Google Scholar
  7. de Almeida, L. F. J., & Vergilio, S. R. (2006). Exploring perturbation based testing for web services. In 2006 IEEE International Conference on Web Services (ICWS 2006), 18–22 September 2006, Chicago, Illinois, USA (pp. 717–726). IEEE Computer Society.Google Scholar
  8. Looker N, Munro M, & Xu J (2004a) Testing web services. In 16th IFIP International Conference on Testing of Communicating Systems, Oxford, 2004.Google Scholar
  9. Looker, N., Munro, M., & Xu, J. (2004b). WS-FIT: A tool for dependability analysis of web services. In 28th International Computer Software and Applications Conference (COMPSAC 2004), Design and Assessment of Trustworthy Software-Based Systems, 27–30 September 2004, Hong Kong, China, Proceedings (pp. 120–123). IEEE Computer Society.Google Scholar
  10. Looker, N., Munro, M., & Xu, J. (2004c) Assessing Web Service Quality of Service with Fault Injection. In Workshop on Quality of Service for Application Servers in conjunction with IEEE Symposium on Reliable Distributed Systems, Brazil, 2004.Google Scholar
  11. Looker, N., & Xu, J. (2003). Assessing the Dependability of SOAP RPC-based Web Services by Fault Injection. In 9th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems (WORDS 2003 Fall), 1–3 October 2003, Anacapri (Capri Island), Italy (pp. 163–170). IEEE Computer Society.Google Scholar
  12. Mei, H., & Zhang, L. (2005). A framework for testing web services and its supporting tool. In: SOSE’05: Proceedings of the IEEE International Workshop 207–214.Google Scholar
  13. Modafferi, S., Mussi, E., & Pernici, B. (2006). SH-BPEL: A Self-healing Plug-in for WS-BPEL Engines. Proceedings of the 1st workshop on Middleware for Service Oriented Computing (MW4SOC 2006) 48–53.Google Scholar
  14. Offutt, J., & Xu, W. (2004). Generating test cases for web services using data perturbation. SIGSOFT. Software Engineering Notes, 29(5), 1–10.Google Scholar
  15. Papazoglou, M. P., Traverso, P., Dustdar, S., & Leymann, F. (2007). Service-oriented computing: State of the art and research challenges. IEEE Computer, 40(11), 38–45.Google Scholar
  16. Papazoglou, M., & van den Heuvel, W. J. (2006). Service-Oriented Design and Development Methodology. International Journal on Web Engineering and Technology, 2(4), 412–442.CrossRefGoogle Scholar
  17. Pernici, B. (2006). 05462 Summary report on “service design and development”. In F. Cubera, B. J. Krämer, M. P. Papazoglou (Eds.), Service Oriented Computing (SOC). Number 05462 in Dagstuhl Seminar Proceedings 2006.Google Scholar
  18. Redman, T. (1996). Data quality for the information age. Artech House: Norwood, MA.Google Scholar
  19. Siblini, R., & Mansour, N. (2005). Testing Web Services. In 2005 ACS/IEEE International Conference on Computer Systems and Applications (AICCSA 2005), January 3–6, 2005, Cairo, Egypt (p. 135). IEEE Computer Society.Google Scholar
  20. Sneed, H. M., & Huang, S. (2006). WSDLTest—a tool for testing web services. In Eighth IEEE International Workshop on Web Site Evolution (WSE 2006), 22–24 September 2006, Philadelphia, Pennsylvania, USA. IEEE Computer Society.Google Scholar
  21. Tixeuil, S., Hoarau, W., & Silva, L. (2006). An overview of existing tools for fault-injection and dependability benchmarking in grids. CoreGRID Workshop on GRID and Peer to Peer Systems Architecture. In Second CoreGRID Workshop on Grid and Peer to Peer Systems Architecture, January 2006, Paris, France.Google Scholar
  22. Wand, Y., & Wang, R. (1996). Anchoring data quality dimensions in ontological foundations. Communications of the ACM, 39(11), 86–95.CrossRefGoogle Scholar
  23. Xu, W., Offutt, J., & Luo, J. (2005). Testingweb services by XML Perturbation. In 16th International Symposium on Software Reliability Engineering (ISSRE 2005), 8–11 November 2005, Chicago, IL, USA (pp. 251–266). IEEE Computer Society.Google Scholar
  24. Zhang, J., & Qiu, R. G. (2006). Fault injection-based test case generation for soa-oriented software. In: IEEE International Conference on Service Operations and Logistics, and Informatics 1070–1078.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Maria Grazia Fugini
    • 1
  • Barbara Pernici
    • 1
    Email author
  • Filippo Ramoni
    • 1
  1. 1.Department of Electronics and InformationPolitecnico di MilanoMilanItaly

Personalised recommendations