This article proposes a novel approach to quantitative software reliability assessment ensuring high interplay coverage for software components and decentralized (sub-)systems. The generation of adequate test cases is based on the measurement of their operational representativeness, stochastic independence and interaction coverage. The underlying multi-objective optimization problem is solved by genetic algorithms. The resulting automatic test case generation supports the derivation of conservative reliability measures as well as high interaction coverage. The practicability of the approach developed is finally demonstrated in the light of an interaction-intensive example.


Software reliability interaction coverage component-based system system of systems emergent behavior statistical sampling theory testing profile multi-objective optimization genetic algorithm 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alexander, R.T., Offutt, A.J.: Coupling-based Testing of O-O Programs. Journal of Universal Computer Science 10(4) (2004)Google Scholar
  2. 2.
    Hartung, J.: Statistik. Oldenbourg (1995)Google Scholar
  3. 3.
    Ehrenberger, W.: Software-Verifikation. Hanser Verlag (2002)Google Scholar
  4. 4.
    Jin, Z., Offutt, A.J.: Coupling-based Criteria for Integration Testing. Software Testing, Verification & Reliability 8(3), 133–154 (1998)CrossRefGoogle Scholar
  5. 5.
    Jung, M., Saglietti, F.: Supporting Component and Architectural Re-usage by Detection and Tolerance of Integration Faults. In: 9th IEEE International Symposium on High Assurance Systems Engineering (HASE 2005). IEEE Computer Society (2005)Google Scholar
  6. 6.
    Law, A.M., Kelton, W.D.: Simulation, Modeling and Analysis. McGraw-Hill (2000)Google Scholar
  7. 7.
    Littlewood, B., Wright, D.: Stopping Rules for Operational Testing of Safety Critical Software. In: 25th International Symposium Fault Tolerant Computing, FCTS 25 (1995)Google Scholar
  8. 8.
    Maier, M.W.: Architecting Principles for Systems-of-Systems. Systems Engineering 1(4), 267–284 (1998)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Oster, N., Saglietti, F.: Automatic Test Data Generation by Multi-objective Optimisation. In: Górski, J. (ed.) SAFECOMP 2006. LNCS, vol. 4166, pp. 426–438. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    Parnas, D., van Schouwen, J., Kwan, S.: Evaluation of Safety-critical Software. Communications of the ACM 33(6) (1990)Google Scholar
  11. 11.
    Quirk, W.J. (ed.): Verification and Validation of Real-time Software. Springer, Heidelberg (1985)Google Scholar
  12. 12.
    Rapps, S., Weyuker, E.J.: Data Flow Analysis Techniques for Test Data Selection. In: 6th International Conference on Software Engineering, ICSE 1982 (1982)Google Scholar
  13. 13.
    Rehman, M., Jabeen, F., Bertolino, A., Polini, A.: Software Component Integration Testing: A Survey. Journal of Software Testing, Verification, and Reliability, STVR (2006)Google Scholar
  14. 14.
    Saglietti, F., Oster, N., Pinte, F.: Interface Coverage Criteria Supporting Model-Based Integration Testing. In: Workshop Proceedings of the 20th International Conference on Architecture of Computing Systems (ARCS 2007), VDE (2007)Google Scholar
  15. 15.
    Söhnlein, S., Saglietti, F., Bitzer, F., Meitner, M., Baryschew, S.: Software Reliability Assessment based on the Evaluation of Operational Experience. In: Müller-Clostermann, B., Echtle, K., Rathgeb, E.P. (eds.) MMB&DFT 2010. LNCS, vol. 5987, pp. 24–38. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
    Söhnlein, S., Saglietti, F., Meitner, M., Bitzer, F.: Bewertung der Zuverlässigkeit von Software, Automatisierungstechnische Praxis, 52. Jahrgang, 6/2010, 32-39, Oldenbourg Industrieverlag (2010)Google Scholar
  17. 17.
    Spillner, A.: Test Criteria and Coverage Measures for Software Integration Testing. Software Quality Journal 4, 275–286 (1995)CrossRefGoogle Scholar
  18. 18.
    Störmer, H.: Mathematische Theorie der Zuverlässigkeit. R. Oldenbourg (1970)Google Scholar
  19. 19.
    Storm, R.: Wahrscheinlichkeitsrechnung, mathematische Statistik und Qualitätskontrolle. Hanser Verlag (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Matthias Meitner
    • 1
  • Francesca Saglietti
    • 1
  1. 1.Chair of Software EngineeringUniversity of Erlangen-NurembergErlangenGermany

Personalised recommendations