Software Reliability Assessment Based on the Evaluation of Operational Experience

  • Sven Söhnlein
  • Francesca Saglietti
  • Frank Bitzer
  • Matthias Meitner
  • Siegfried Baryschew
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5987)


This paper illustrates a practicable approach to reliability evaluation for highly reliable software systems based on the analysis of their operational experience and demonstrates its applicability to the control software of a gearbox system. The investigations were carried out within a cooperation of academia and automotive industry. The article also elaborates on the possibility of assessing software reliability at system level by combination of component-specific software reliability estimates.


Highly reliable software operational experience statistical testing component-based systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amari, S., Misra, R.: Closed-form Expressions for Distribution of Sum of Exponential Random Variables. IEEE Transactions on Reliability 46(4) (1997)Google Scholar
  2. 2.
    Bhargava, R.P., Khatri, C.G.: The Distribution of Product of Independent Beta Random Variables with Application to Multivariate Analysis. Annals of the Institute of Statistical Mathematics 33, 287–296 (1981)MATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    Butler, R., Finelli, G.: The Infeasibility of Quantifying the Reliability of Life-critical Real-time Software. Software Engineering 19(1) (1993)Google Scholar
  4. 4.
    Cox, D.: Renewal Theory. Methuen & Co. (1962)Google Scholar
  5. 5.
    Ehrenberger, W.: Software-Verifikation. Hanser (2002)Google Scholar
  6. 6.
    Heinhold, J., Gaede, K.: Ingenieur-Statistik. Oldenbourg (1972)Google Scholar
  7. 7.
    Law, A.M., Kelton, W.D.: Simulation, Modeling and Analysis. McGraw-Hill, New York (2000)Google Scholar
  8. 8.
    Limbourg, P., Savic, R., Petersen, J., Kochs, H.D.: Modelling Uncertainty in Fault Tree Analyses Using Evidence Theory. Journal of Risk and Reliability 222, 291–302 (2008)Google Scholar
  9. 9.
    Littlewood, B., Strigini, L.: Validation of Ultra-high Dependability for Software-based Systems. Communications of the ACM 36(11) (1993)Google Scholar
  10. 10.
    Littlewood, B., Wright, D.: Stopping Rules for Operational Testing of Safety Critical Software. In: Proc. 25th International Symposium Fault Tolerant Computing (FTCS 25). IEEE, Los Alamitos (1995)Google Scholar
  11. 11.
    Littlewood, B., Strigini, L.: Software Reliability and Dependability: A Roadmap. In: The Future of Software Engineering. ACM, New York (2000)Google Scholar
  12. 12.
    Miller, K.W., Morell, L.J., Noonan, R.E., Park, S.K., Nicol, D.M., Murrill, B.W., Voas, J.F.: Estimating the Probability of Failure When Testing Reveals No Failures. IEEE Transactions on Software Engineering 18(1) (January 1992)Google Scholar
  13. 13.
    Parnas, D., van Schouwen, J., Kwan, S.: Evaluation of Safety-critical Software. Communications of the ACM 33(6) (1990)Google Scholar
  14. 14.
    Quirk, W.J. (ed.): Verification and Validation of Real-time Software. Springer, Heidelberg (1985)Google Scholar
  15. 15.
    Saglietti, F.: Evaluation of Pre-developed Software for Usage in Safety Critical Systems. In: Proc. 26th EUROMICRO Conference (EUROMICRO 2000). IEEE, Los Alamitos (2000)Google Scholar
  16. 16.
    Saglietti, F., Pinte, F., Söhnlein, S.: Integration and Reliability Testing for Component-based Software Systems. In: Proc. 35th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA 2009). IEEE, Los Alamitos (2009)Google Scholar
  17. 17.
    Söhnlein, S., Saglietti, F.: Auswertung der Betriebserfahrung zum Zuverlässigkeits-nachweis sicherheitskritischer Softwaresysteme. In: Proc. Automotive 2008 - Safety & Security, Sicherheit und Zuverlässigkeit für automobile Informationstechnik, Stuttgart (2008)Google Scholar
  18. 18.
    Söhnlein, S., Saglietti, F., Bitzer, F., Baryschew, S.: Zuverlässigkeitsbewertung einer Getriebesteuerungs-Software durch Auswertung der Betriebserfahrung. Softwaretechnik-Trends, GI 29(3) (2009)Google Scholar
  19. 19.
    Störmer, H.: Mathematische Theorie der Zuverlässigkeit. Oldenbourg (1970)Google Scholar
  20. 20.
    Trivedi, K.: Probability & Statistics with Reliability, Queuing, and Computer Science Applications. Prentice-Hall, Englewood Cliffs (1982)Google Scholar
  21. 21.
    Wilks, S.: Determination of Sample Sizes for Setting Tolerance Limits. Annals of Mathematical Statistics 12, 91–96 (1941)MATHCrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Sven Söhnlein
    • 1
  • Francesca Saglietti
    • 1
  • Frank Bitzer
    • 2
  • Matthias Meitner
    • 1
  • Siegfried Baryschew
    • 1
  1. 1.Chair of Software EngineeringUniversity of Erlangen-NurembergErlangenGermany
  2. 2.LPE2-FB/Functions Basic DevelopmentZF Friedrichshafen AGFriedrichshafenGermany

Personalised recommendations