Skip to main content
SpringerLink
Log in

Heuristic-Driven Test Case Selection from Formal Specifications. A Case Study

  • Conference paper
  • First Online:
FME 2002:Formal Methods—Getting IT Right (FME 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2391))

Included in the following conference series:

Abstract

We propose an approach to testing that combines formal methods with practical criteria, close to the testing engineer’s experience. It can be seen as a framework to evaluate and select test suites using formal methods, assisted by informal heuristics. This proposal is illustrated with a practical case study: the testing of a protocol for mobile auctions in a distributed, wireless environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alilovic-Curgus, J., Vuong, S.T.: A Metric Based Theory of Test Selection and Coverage. Protocol Specification, Testing and VerificationXIII. Elsevier Science Publishers B.V. IFIP, 1993.

    Google Scholar 

  2. Bertsekas, D., Gallagher, R.: Data Networks, Prentice-Hall International Ed., 1992.

    Google Scholar 

  3. Brookes, S.D., Hoare, C.A.R., Roscoe, A.W.: A Theory of Communicating Sequential Processes. Journal of the ACM 31, 1984

    Google Scholar 

  4. Brinksma, E.: A Theory for the Derivation of Tests. Protocol Specification, Testing and Verification VIII, 63–74. 1988.

    Google Scholar 

  5. Brinksma, E., Tretmans J., Verhaard, L.: A Framework for Test Selection. Protocol Specification, Testing and Verification, XI. Elsevier Science Publishers B.V. 233–248, 1991.

    Google Scholar 

  6. Burguillo-Rial, J.C.: Contribución a la Fase de Prueba de Sistemas Concurrentes y Distribuidos mediante Técnicas de Descripción Formal. Ph. D. Dissertation (in Spanish), Universidad de Vigo, Spain, 2001.

    Google Scholar 

  7. ETSI: “Digital cellular telecommunications system (phase 2+); Multiplexing and multiple access on the radio path (GSM 05.02 version 5.4.1)”. ETSI technical report ETR 300 908, 1997.

    Google Scholar 

  8. Fernández-Iglesias, M. J., Llamas-Nistal, M.: Algebraic Specification through Expression Transformation, in: Mizuno, T., Shiratori, N., Higashino, T., Togashi, A., (Eds.), Procs. of the Joint Conference FORTE/PSTV’97, Chapman & Hall, 1997, 355–366.

    Google Scholar 

  9. Fernández-Iglesias, M. J., González-Castaño, F. J., Pousada-Carballo, J. M., Llamas-Nistal, M., and Romero-Feijoo, A.: From Complex Specifications to a Working Prototype. A Protocol Engineering Case Study. Procs. of FME 2001. Lecture Notes on Computer Science 2021, 436–448.

    Google Scholar 

  10. Heerink, L., Tretmans, J.: Formal Methods in Conformance Testing: a Probabilistic Refinement. In B. Baumgarten, H.J. Burkhardt, and A. Giessler, editors, Int. Workshop on Testing of Communicating Systems IX, Chapman & Hall, 1996, 261–276.

    Google Scholar 

  11. Holzmann, G.: Design and Validation of Computer Protocols, Prentice Hall, 1991.

    Google Scholar 

  12. Huecas, G.: Contribución a la Formalización de la Fase de Ejecución de Pruebas. Ph. D. Dissertation (in Spanish), Universidad Politécnica de Madrid, Spain, 1995.

    Google Scholar 

  13. Information Processing Systems-Open Systems Interconnections: LOTOS: A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour. IS 8807, ISO, 1989.

    Google Scholar 

  14. Information Processing Systems-Open Systems Interconnections: Conformance Testing Methodology and Framework. IS 9646, ISO, 1991.

    Google Scholar 

  15. Information Processing Systems-Open Systems Interconnections: ESTELLE: A formal description technique based on the extended state transition model. IS 9074, ISO, 1989.

    Google Scholar 

  16. ITU-T: Recommendation Recommendation Z.500. Framework on Formal Methods in Conformance Testing. ISO ITU-T, Mayo 1997.

    Google Scholar 

  17. ITU-T: SDL: Specification and Description Language, CCITT Recommendation Z.100, International Telecommunication Union, 1993.

    Google Scholar 

  18. Koenig, H., Ulrich, A., Heiner, M.: Design for Testability: a Step-Wise Approach to Protocol Testing. Testing of Communicating Systems. Volume 10. 1997

    Google Scholar 

  19. Leduc, G.: Failure-based Congruences, Unfair Divergences and New Testing Theory. Proceedings of PSTV XIV, Vancouver, Canadá, Junio 1994. Chapman & Hall, 252–267, 1995.

    Google Scholar 

  20. Mañas, J. A., de Miguel, T.: From LOTOS to C, in: K. J. Turner, (Ed), Procs. of FORTE’88, North Holland, 1988, 79–84.

    Google Scholar 

  21. Mañas, J. A., de Miguel, T., Salvachúa, J., Azcorra, A.: Tool support to implement LOTOS specifications, Computer Networks and ISDN Systems, 25 (1993) 79–84.

    Article  Google Scholar 

  22. Miller, G. H: Microcomputer Engineering, Prentice Hall, 1993.

    Google Scholar 

  23. Milner, R.: Communication and Concurrency. Prentice-Hall International, London, 1989

    MATH  Google Scholar 

  24. Musa, J.D., Ackerman, A.F.: Quantifying Software Validation: When to Stop Testing?. IEEE Trans. Soft. Eng., 19–26, 1989.

    Google Scholar 

  25. Myers, G.L.: The Art of Software Testing. John Wiley & Sons Inc., 1979.

    Google Scholar 

  26. Quemada, J., Pavón, S., Fernández, A.: Transforming LOTOS specification with LOLA, in: Turner, K. J., (Ed), Procs. of FORTE’88, North Holland, 1988.

    Google Scholar 

  27. Robles, T.: Contribución al Tratamiento Formal de la Fase de Pruebas del Ciclo Software en Ingeniería de Protocolos. Ph. D. Dissertation (in Spanish), Universidad Politécnica de Madrid, Spain, 1991.

    Google Scholar 

  28. Robles, T., Mañas, J. A., Huecas, G.: Specification and Derivation of OSI Conformance Test Suites. Protocol Test Systems, V. Elsevier Science Publishers. 177–188. IFIP, 1993.

    Google Scholar 

  29. Rodríguez-Hernández, P. S., González-Castaño, F. J., Pousada-Carballo, J. M., Fernández-Iglesias, M. J., García-Reinoso, J.: Cellular Network for Real-Time Mobile Auction. Wireless Personal Communications (Submitted).

    Google Scholar 

  30. Tretmans, J.: A Formal Approach to Conformance Testing. Ph. D. Dissertation, University of Twente, Enschede, The Netherlands, 1992.

    Google Scholar 

  31. Tretmans, J.: Conformance Testing with Labelled Transition Systems: Implementation Relations and Test Generation. Computer Networks and ISDN Systems, 29: 49–79, 1996.

    Article  Google Scholar 

  32. Ulrich, A., Koenig, H.: Test Derivation from LOTOS using Structure Information. Protocol Test Systems VI. 1994.

    Google Scholar 

  33. Velthuys, R.J., Schneider, J.M., Zoerntlein, G.: A Test Derivation Method Based on Exploiting Structure Information. Protocol Specification, Testing and Verification XII, 1992.

    Google Scholar 

  34. Williams, T.W., Parker, K.P.: Design for Testability-A Survey. IEEE Trans. on Computers C-31,1, 2–15. 1982.

    Article  Google Scholar 

  35. Zju, J., Vuong, S.T.: Generalized Metric Based Test Selection and Coverage Measure for Communication protocols. Formal Description Techniques and Protocol Specification, Testing and Verification. FORTE X/PSTV XVII. IFIP 1997.

    Google Scholar 

  36. Zju, J., Vuong, S.T., Chanson, S.T.: Evaluation of Test Coverage for Embedded System Testing. 11th International Workshop on Testing of Communicating Systems. 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Grupo de Ingeniería de Sistemas Telemáticos Departamento de Ingeniería Telemática, Universidade de Vigo, Spain

    Juan C. Burguillo-Rial, Manuel J. Fernández-Iglesias, Francisco J. González-Castaño & Martín Llamas-Nistal

Authors
  1. Juan C. Burguillo-Rial
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manuel J. Fernández-Iglesias
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francisco J. González-Castaño
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martín Llamas-Nistal
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information Technology, Uppsala University, P.O. Box 337, 751 05, Uppsala, Sweden

    Lars-Henrik Eriksson

  2. Software Verification Research Centre, The University of Queensland, Queensland, 4072, Australia

    Peter Alexander Lindsay

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Burguillo-Rial, J.C., Fernández-Iglesias, M.J., González-Castaño, F.J., Llamas-Nistal, M. (2002). Heuristic-Driven Test Case Selection from Formal Specifications. A Case Study. In: Eriksson, LH., Lindsay, P.A. (eds) FME 2002:Formal Methods—Getting IT Right. FME 2002. Lecture Notes in Computer Science, vol 2391. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45614-7_4

Download citation

  • DOI: https://doi.org/10.1007/3-540-45614-7_4

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43928-8

  • Online ISBN: 978-3-540-45614-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation