Abstract
In this paper a general framework is presented for testing time-critical systems and software. The main focus is to derive a state-oriented statistical usage model from a set of usage scenarios in order to automatically generate test cases. We describe a methodology that was developed within the European IST project MaTeLo to ease testing by combining the advantages of formal description techniques, namely MSC, UML and TTCN-3. In the first step of our approach, a MCUM (Markov Chain Usage Model) is constructed. This model represents the formal basis for deriving TTCN-3 test case descriptions to perform executable specification-based tests for the system under test (SUT). In order to be independent of the chosen specification technique, i.e. MSC or UML sequence diagrams, we have defined an XML-based representation format for the MCUM, called MCML (Markov Chain Markup Language). This format represents a common interface between various tools of the MaTeLo approach. All steps in our methodology do also support the testing of QoS (Quality of Service) requirements that are annoted in a UML profile standard notation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sayre, K.: Improved Techniques for Software Testing Based on Markov Chain Usage Models. PhD thesis, University of Tennessee, Knoxville (December 1999)
Dauphin, P., Dulz, W., Lemmen, F.: Specification-driven Performance Monitoring of SDL/MSC-specified Protocols. In: 8th Int. Workshop on Protocol Test Systems, Evry (September 1995)
Selvidge, J.M.: Statistical usage testing: Expanding the ability of testing (1999)
Whittaker, J.A., Poore, J.H., Trammel, C.J.: Statistical testing of software based on a usage model. Software-practice and experience (January 25,1995)
Cai, K.-Y.: Optimal software testing and adaptive software testing in the context of software cybernetics. Information and Software Technology 44/11, 841–855 (2002)
Schieferdecker, I.K., Mertens, A., Mertens, O.: Timed MSCs - an Extension to MSC 1996. In: GI/ITG-Workshop on Formal Description Techniques for Distributed Systems, GMD-Studien Nr.315, Berlin, pp. 165–174 (1997)
Lambert, L.: PMSC for Performance Evaluation. In: Workshop on Performance and Time in SDL and MSC, Erlangen, Germany, February 17-19 (1998)
Grabowski, J.: Test Case Generation and Test Case Specification with Message Sequence Charts. Inauguraldissertation, Universität Bern (Febuary 1994)
Schieferdecker, I., Stepien, B., Rennoch, A.: PerfTTCN, a TTCN language extension for performance testing. In: 10th Intern. Workshop on Testing of Communicating Systems IWTCS 1997, Cheju Island, Korea (September 1997)
Dai, Z.R., Grabowski, J., Neukirchen, H.: TimedTTCN-3 – A Real-Time Extension For TTCN-3 (March 2002)
Grabowski, J., Wiles, A., Willcock, C., Hogrefe, D.: On the design of the new testing language TTCN-3. In: Proceedings 13th IFIP International Workshop on Testing Communication Systems (TestCom 2000), Ottawa (August 2000)
Slomka, F., Dörfel, M., Münzenberger, R., Hofmann, R.: Hardware/Software Codesign and Rapid-Prototyping of Embedded Systems. IEEE Design & Test of Computers, Special issue: Design Tools for Embedded Systems 17(2) (April-June 2000)
Dörfel, M., Dulz, W., Hofmann, R., Münzenberger, R.: Time Extensions and Non-Functional Requirements in SDL, Technical Report IMMD7-01-05, Department of Computer Science 7, Univ. of Erlangen/Nuremberg (August 2001)
Object Management Group: UML Testing Profile version 2.0, Final Adopted Specification, ptc/2004-04-02
Object Management Group. UML Profile for Schedulability, Performance and Time Specification, Version 1.0, formal/03-09-01 (September 2003)
Object Management Group. OMG XML Metadata Interchange (XMI) Specification Version 1.2 (January 2002)
Object Management Group. Unified Modeling Language Specification, Version 1.3a1 (January 1999)
ETSI. Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; ES 201 873 V2.2.1 (2002)
ITU. Message Sequence Chart. Standard Z.120 (1996)
Dulz, W., Zhen, F.: MaTeLo - Statistical Usage Testing by Annotated Sequence Diagrams. In: Markov Chains and TTCN-3. Third International Conference on Quality Software (QSIC 2003), Dallas, Texas, November 6-7 (2003)
Walton, G.H., Poore, J.H.: Generating transition probabilities to support model-based software testing. Software – Practice and Experience 30, 1095–1106 (2000)
Schaefer, W.: Dept. of Computer Science, Software Engineering Group, Univ. of Paderborn, http://wwwcs.upb.de/cs/ag-schaefer/CaseStudies/ShuttleSystem/
Gutjahr., W.J.: Importance Sampling of Test Cases in Markovian Software Usage Models. Department of Statistics, Operations Research and Computer Science. University of Vienna (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Beyer, M., Dulz, W. (2005). Scenario-Based Statistical Testing of Quality of Service Requirements. In: Leue, S., Systä, T.J. (eds) Scenarios: Models, Transformations and Tools. Lecture Notes in Computer Science, vol 3466. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11495628_9
Download citation
DOI: https://doi.org/10.1007/11495628_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26189-6
Online ISBN: 978-3-540-32032-6
eBook Packages: Computer ScienceComputer Science (R0)