Skip to main content

A Framework for Analyzing and Testing the Performance of Software Services

  • Conference paper

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 17))

Abstract

Networks “Beyond the 3rd Generation” (B3G) are characterized by mobile and resource-limited devices that communicate through different kinds of network interfaces. Software services deployed in such networks shall adapt themselves according to possible execution contexts and requirement changes. At the same time, software services have to be competitive in terms of the Quality of Service (QoS) provided, or perceived by the end user.

The PLASTIC project proposes an integrated model-based solution to the development and maintenance of services deployable over B3G networks. Notably, the PLASTIC solution includes formal techniques that combine predictive and empirical evaluation of QoS-aware services.

In this paper we provide an overview of the PLASTIC approach to the assessment of QoS properties. Referring to a complex eHealth service, we first generate and analyze performance models to establish requirements for stand-alone services. Then we use an empirical technique to test the QoS of an orchestration of services even when the actual implementations of the orchestrated services are not available.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bertolino, A., Bonivento, A., De Angelis, G., Sangiovanni Vincentelli, A.: Modeling and Early Performance Estimation for Network Processor Applications. In: Proc. of 9th MoDELS. Springer, Heidelberg (2006)

    Google Scholar 

  2. Ludwig, H.: WS-Agreement Concepts and Use – Agreement-Based Service-Oriented Architectures. Technical report, IBM (2006)

    Google Scholar 

  3. Woodside, M., Franks, G., Petriu, D.: The future of software performance engineering. In: FOSE 2007: 2007 Future of Software Engineering, pp. 171–187. IEEE Computer Society Press, Los Alamitos (2007)

    Google Scholar 

  4. PLASTIC Project: (EU FP6 STREP n. 26955), http://www.ist-plastic.org

  5. Autili, M., Berardinelli, L., Cortellessa, V., Di Marco, A., Di Ruscio, D., Inverardi, P., Tivoli, M.: A development process for self-adapting service oriented applications. In: Krämer, B.J., Lin, K.-J., Narasimhan, P. (eds.) ICSOC 2007. LNCS, vol. 4749, pp. 442–448. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  6. Autili, M., Cortellessa, V., Di Marco, A., Inverardi, P.: A conceptual model for adaptable context-aware services. In: WS-MaTe 2006 (2006)

    Google Scholar 

  7. Bass, L., Clements, P., Kazman, R.: Quality Attributes. In: Software Architecture in Practice, ch. 4, pp. 75–91. Addison-Wesley, Reading (1998)

    Google Scholar 

  8. Cortellessa, V., Mirandola, R.: PRIMA-UML: a Performance Validation Incremental Methodology on Early UML Diagrams. Science of Computer Programming 44(1), 101–129 (2002)

    Article  MATH  Google Scholar 

  9. Di Marco, A.: Model-based Performance Analysis of Software Architectures. PhD thesis, University of L’Aquila (2005)

    Google Scholar 

  10. Di Marco, A., Mascolo, C.: Performance Analysis and Prediction of Physically Mobile Systems. In: ACM WOSP, Buenos Aires (Argentina) (2007)

    Google Scholar 

  11. Cortellessa, V., Singh, H., Cukic, B.: Early reliability assessment of UML based software models. In: ACM WOSP, pp. 302–309 (2002)

    Google Scholar 

  12. Inverardi, P., Mancinelli, F., Nesi, M.: A declarative framework for adaptable applications in heterogeneous environments. In: ACM SAC (2004)

    Google Scholar 

  13. SEA Group: (The Chameleon Project), http://www.di.univaq.it/chameleon/

  14. Autili, M., Di Benedetto, P., Inverardi, P., Mancinelli, F.: A resource-oriented static analysis approach to adaptable Java applications. In: Proc. of CORCS 2008 (IEEE/COMPSAC 2008). IEEE Computer Society Press, Los Alamitos (to appear, 2008)

    Google Scholar 

  15. Bertolino, A., De Angelis, G., Polini, A.: A QoS Test-bed Generator for Web Services. In: Baresi, L., Fraternali, P., Houben, G.-J. (eds.) ICWE 2007. LNCS, vol. 4607, pp. 17–31. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  16. IBM: BPEL4WS, Business Process Execution Language for Web Services, v.1.1 (2003)

    Google Scholar 

  17. MOSQUITO: (User manual), http://sealabtools.di.univaq.it/SeaLab/MosquitoHome.html

  18. WEASEL: (User manual), http://sealabtools.di.univaq.it/SeaLab/Weasel

  19. Smith, C.U., Llado, C.M.: Performance model interchange format (pmif 2.0): XML definition and implementation. In: QEST 2004 Proceedings, pp. 38–47. IEEE Computer Society Press, Los Alamitos (2004)

    Google Scholar 

  20. Chereddi, C.: Mean Value Analysis for Closed, Separable, Multi Class Queueing Networks with Single Server & Delay Queues (2006)

    Google Scholar 

  21. Sahner, R.A., Trivedi, K.S.: SHARPE: Symbolic Hierarchical Automated Reliability and Performance Evaluator, Introduction and Guide for Users (2002)

    Google Scholar 

  22. Smith, C., Williams, L.: Performance Solutions: A practical Guide To Creating Responsive, Scalable Software. Addison Wesley, Reading (2001)

    Google Scholar 

  23. Liu, Y., Gorton, I.: Accuracy of Performance Prediction for EJB Applications: A Statistical Analysis. In: Gschwind, T., Mascolo, C. (eds.) SEM 2004. LNCS, vol. 3437, pp. 185–198. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  24. Bertolino, A., De Angelis, G., Frantzen, L., Polini, A.: Model-based Generation of Testbeds for Web Services. In: Suzuki, K., Higashino, T., Hasegawa, T., Ulrich, A. (eds.) TestCom/FATES 2008. LNCS, vol. 5047, pp. 266–282. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  25. Bertolino, A., De Angelis, G., Lonetti, F., Sabetta, A.: Let The Puppets Move! Automated Testbed Generation for Service-oriented Mobile Applications. In: Proc. of the 34th € μ-SEAA, Parma, Italy, IEEE Computer Society Press, Los Alamitos (2008)

    Google Scholar 

  26. Frantzen, L., Tretmans, J., Willemse, T.A.C.: A Symbolic Framework for Model-Based Testing. In: Havelund, K., Núñez, M., Roşu, G., Wolff, B. (eds.) FATES 2006 and RV 2006. LNCS, vol. 4262, pp. 40–54. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  27. Skene, J., Skene, A., Crampton, J., Emmerich, W.: The Monitorability of Service-Level Agreements for Application-Service Provision. In: Proc. of WOSP 2007, pp. 3–14 (2007)

    Google Scholar 

  28. ASG: (EU IST FP6), http://asg-platform.org/

  29. COMET: (EU IST FP6), https://www.comet-consortium.org/

  30. MADAM: (EU IST FP6), http://www.ist-madam.org

  31. MUSIC: (EU IST FP6), http://www.ist-music.eu/

  32. SeCSE: (EU IST FP6), http://secse.eng.it

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bertolino, A., De Angelis, G., Di Marco, A., Inverardi, P., Sabetta, A., Tivoli, M. (2008). A Framework for Analyzing and Testing the Performance of Software Services. In: Margaria, T., Steffen, B. (eds) Leveraging Applications of Formal Methods, Verification and Validation. ISoLA 2008. Communications in Computer and Information Science, vol 17. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88479-8_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-88479-8_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-88478-1

  • Online ISBN: 978-3-540-88479-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics