Skip to main content
SpringerLink
Log in

FSM-based testing from user defined faults adapted to incremental and mutation testing

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

We study the problem of deriving a test suite with guaranteed fault coverage from a given finite state machine specification with respect to some given user defined faults. We consider the case when an implementation under test can have more states than its specification while user defined faults are implemented in an arbitrary way. We show that our approach can be used for FSM-based incremental and mutation testing and correspondingly we investigate cases that can be used for reducing length of obtained test suites. In some cases, worst-case length of obtained test suite becomes polynomial. Experiments show significant gains is using our approach in comparison to testing the whole specification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bochmann, G. and Petrenko, A., Protocol Testing: Review of Methods and Relevance for Software Testing, Proc. of the International Symposium on Software Testing and Analysis (ISSTA 1994) (Seattle, 1994), pp. 109–123.

  2. Chow, T.S., Test Design Modeled by Finite-State Machines, IEEE Trans. Software Eng., 1978, vol. 4, no. 3, pp. 178–187.

    Article  MATH  Google Scholar 

  3. De Souza, S. de R., Maldonado, J.C., Fabbri, S.C.P.F., and De Souza, W.L., Mutation Testing Applied to Estelle Specifications, Proc. of the 33rd Annual Hawaii International Conference on System Sciences (HICSS), Hawaii: IEEE Computer Society, 2000.

    Google Scholar 

  4. Dorofeeva, R., El-Fakih, K., and Yevtushenko, N., An Improved FSM-Based Conformance Testing Method, Proc. of the IFIP 25th International Conference on Formal Methods for Networked and Distributed Systems, Taiwan: Lecture Notes in Computer Science 3731, 2005a, pp. 204–218.

  5. Dorofeeva, R., El-Fakih, K., Maag, S., Cavalli, A.R., and Yevtushenko, N., Experimental Evaluation of FSM-Based Testing Methods, Proc. of the IEEE International Conference on Software Engineering and Formal Methods (SEFM05), Germany, 2005b, pp. 23–32.

  6. Dorofeeva, R., El-Fakih, K., Maag, S., Cavalli, A.R., and Yevtushenko, N., FSM-Based Conformance Testing Methods: a Survey Annotated with Experimental Evaluation, Inform. Software Technol. J., Elsevier, 2010, vol. 52, pp. 1286–1297.

    Article  Google Scholar 

  7. El-Fakih, K., Yevtushenko, N., and Bochmann, G.V., FSM-Based Incremental Conformance Testing Methods, IEEE Trans. Software Eng., 2004, vol. 30, no. 7, pp. 425–436.

    Article  Google Scholar 

  8. Fabbri, S.C.P.F., Maldonado, J.C., Masiero, P.C., and Delamaro, M.E., Mutation Analysis Testing for Finite State Machines, Proc. of the 5th International Symposium on Software Reliability Engineering. Monterey (California, 1994), pp. 220–229.

  9. Fabbri, S.C.P.F., Maldonado, J.C., Delamaro, M.E., and Masiero, P.C., Proteum/FSM: A Tool to Support Finite State Machine Validation Based on Mutation Testing, Proc. of the XIX International Conference of the Chilean Computer Science Society (SCCC1999) (Talca, Chile, 1999), pp. 96–104.

  10. Fujiwara, S., Bochmann, G.V., Khendek, F., Amalou, M., and Ghedamsi, A., Test Selection Based on Finite State Models, IEEE Trans. Software Eng., 1991, vol. 17, no. 6, pp. 591–603.

    Article  Google Scholar 

  11. Gill, A., Introduction to the Theory of Finite-State Machines, McGraw-Hill, 1962.

  12. Hierons, R.M. and Merayo, M.G., Mutation Testing from Probabilistic and Stochastic Finite State Machines, J. Systems Software, 2009, vol. 82, no. 11, pp. 1804–1818.

    Article  Google Scholar 

  13. Jia, Y. and Harman, M., An Analysis and Survey of the Development of Mutation Testing, King’s College, Londin, Crest Center, Technical Report TR-09-06.

  14. Koufareva, I., Petrenko, A., and Yevtushenko, N., Test Generation Driven by User-Defined Fault Models, Proc. of the 11th International Conference on Testing of Communicating Systems (TestCom 1999) (Hungary, 1999), pp. 215–233.

  15. Koufareva, I. and Dorofeeva, R., A Novel Modification of W-Method, Joint Bull. Novosibirsk Comput. Center and A.P. Ershov Inst. Inform. Systems, 2002, vol. 18, pp. 69–81.

    Google Scholar 

  16. Lee, D. and Yannakakis, M., Testing Finite-State Machines: State Identification and Verification, IEEE Trans. Comput., 1994, vol. 43, no. 3.

  17. Lee, D. and Yannakakis, M., Principles and Methods of Testing Finite State Machines-a Survey, Proc. IEEE, 1996, vol. 84, no. 8, pp. 1090–1123.

    Article  Google Scholar 

  18. Maldonado, J.C., Sugeta, T., and Wong, W.E., Mutation Testing Applied to Validate sdl Specifications, Proc. of the 16th IFIP International Conference on Testing of Communicating Systems (TestCom 2004), Springer LNCS 2978, pp. 193–208.

  19. Petrenko, A., Checking Experiments with Protocol Machines, Proc. of the 4th International Workshop on Protocol Test Systems (IWPTS 1991) (Netherlands, 1991), pp. 83–94.

  20. Petrenko, A. and Yevtushenko, N., Test Suite Generation for a fsm with a Given Type of Implementation Errors, Proc. of the 12th International Workshop on Protocol Specification, Testing and Verification (Canada, 1992), pp. 229–243.

  21. Petrenko, A., Yevtushenko, N., Lebedev, A., and Das, A., Nondeterministic State Machines in Protocol Conformance Testing, Proc. of the IFIP 6th Sixth International Workshop on Protocol Test systems (France, 1993), pp. 363–378.

  22. Petrenko, A. and Yevtushenko, N., Testing from Partial Deterministic FSM Specifications, IEEE Trans. Comput., 2005, vol. 54, no. 9, pp. 1154–1165.

    Article  Google Scholar 

  23. Simao, A., Petrenko A., and Yevtushenko, N., Generating Reduced Tests for FSMs with Extra States, Proc. of the 21th International Conference on Testing of Communicating Systems and the 9th International Workshop on Formal Approaches to Testing of Software (TestCom/Fates 2009), LNCS 5826, pp. 129–145.

  24. Starke, P., Abstract Automata, American Elsevier, 1972.

  25. Vasilevskii, M.P., Failure Diagnosis of Automata, Kibernetika, 1973, vol. 4, pp. 98–108.

    MathSciNet  Google Scholar 

  26. Vuong, S.T., Chan, W.W.L., and Ito, M.R., The UIOvMethod for Protocol Test Sequence Generation, Proc. of the IFIP International Workshop on Protocol Test Systems, 1989, pp. 161–175.

  27. Yannakakis, M. and Lee, D., Testing Finite State Machines: Fault Detection, J. Comput. System Sci.. 1995, vol. 50, pp. 209–227.

    Article  MathSciNet  MATH  Google Scholar 

  28. Yevtushenko, N. and Petrenko, A., Test Derivation Method for an Arbitrary Deterministic Automaton, in Automatic Control and Computer Sciences, USA: Allerton Press Inc., 1990, p. 5.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, American University of Sharjah, Sharjah, UAE, PO Box: 26666

    K. A. El-Fakih

  2. Tomsk State University, 36 Lenin Str., Tomsk, 634050, Russia

    R. Dorofeeva & N. V. Yevtushenko

  3. University of Ottawa, Ottawa, Ont., K1N 6N5, Canada

    G. V. Bochmann

Authors
  1. K. A. El-Fakih
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. R. Dorofeeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. N. V. Yevtushenko
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. G. V. Bochmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. A. El-Fakih.

Additional information

The article is published in the original.

Rights and permissions

Reprints and permissions

About this article

Cite this article

El-Fakih, K.A., Dorofeeva, R., Yevtushenko, N.V. et al. FSM-based testing from user defined faults adapted to incremental and mutation testing. Program Comput Soft 38, 201–209 (2012). https://doi.org/10.1134/S0361768812040019

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768812040019

Keywords

Search

Navigation