Stochastic software testing

  • James A. Whittaker
Article

Abstract

This paper presents a method for test case selection that allows a formal approach to testing software. The two main ideas are (1) that testers create stochastic models of software behavior instead of crafting individual test cases and (2) that specific test cases are generated from the stochastic models and applied to the software under test. This paper describes a method for creating a stochastic model in the context of a solved example. We concentrate on Markov models and show how non‐Markovian behavior can be embedded in such models without violating the Markov property.

References

  1. Avritzer, A. and E. Weyuker (1995), “Automatic Generation of Load Test Suites and the Assessment of the Resulting Software,” IEEE Transactions on Software Engineering 21,9, 705–716.CrossRefGoogle Scholar
  2. Dahle, O. (1995), “Statistical Usage Testing Applied to Mobile Telecommunication Systems,” MS Thesis, Department of Computer Science, University of Trondheim, Trondheim, Norway.Google Scholar
  3. Duran, J. and S. Ntafos (1984), “An Evaluation of Random Testing,” IEEE Transactions on Software Engineering 10,4, 438–444.Google Scholar
  4. Duran, J. and J. Wiorkowski (1984), “Quantifying Software Validity by Sampling,” IEEE Transactions on Reliability 29,2, 141–144.CrossRefGoogle Scholar
  5. Feller, W. (1950), An Introduction to Probability Theory and its Application, Volume 1, Wiley, New York, NY.Google Scholar
  6. Hamlet, D. and R. Taylor (1990), “Partition Testing Does Not Inspire Confidence,” IEEE Transactions on Software Engineering 16,12, 1402–1411.CrossRefMathSciNetGoogle Scholar
  7. Houghtaling, M. (1996), “Automation Frameworks for Markov Chain Statistical Testing,” In Proceedings of the Automated Software Test and Evaluation Conference, EFPDMA Press, Washington, DC.Google Scholar
  8. Ostrand, T. and M. Balcer (1988), “The Category-Partition Method for Specifying and Generating Functional Tests,” Communications of the ACM 31,6, 676–686.CrossRefGoogle Scholar
  9. Poore, J.H., H.D. Mills, and D.M. Mutchler (1993), “Planning and Certifying Software System Reliability,” IEEE Software 10,1, 88–99.CrossRefGoogle Scholar
  10. Rautakorpi, M. (1995), “Application of Markov Chain Techniques in Certification of Software,” MS Thesis, Department of Mathematics and Systems Analysis, Helsinki University of Technology, Helsinki, Finland.Google Scholar
  11. Thevenod-Fosse, P. and H. Waeselynck (1993), “STATEMATE Applied to Statistical Software Testing,” In Proceedings of the International Symposium on Software Testing and Analysis, ACM Press, Cambridge, MA, pp. 99–109.Google Scholar
  12. Whittaker, J. and M. Thomason (1994), “A Markov Chain Model for Statistical Software Testing,” IEEE Transactions on Software Engineering 20,10, 812–824.CrossRefGoogle Scholar
  13. Whittaker, J.A. (1992), “Markov Chain Techniques for Software Testing and Reliability Analysis,” PhD Dissertation, Department of Computer Science, University of Tennessee, Knoxville, TN.Google Scholar

Copyright information

© Kluwer Academic Publishers 1997

Authors and Affiliations

  • James A. Whittaker
    • 1
  1. 1.Florida Institute of TechnologyMelbourneUSA

Personalised recommendations