Skip to main content

A tale of two paradigms: Formal methods and software testing

  • Conference paper
Z User Workshop, Cambridge 1994

Part of the book series: Workshops in Computing ((WORKSHOPS COMP.))

Abstract

There are two camps of software developers: formal methods advocates battling against traditionalist supporters of software testing and assessment metrics. Surely, as Turing observed, we will (must) never do away with testing in some form. But clearly, formal methods cannot be ignored, and must be the basis of quality assurance in some form. Important impacts of specifications on testing are in test selection, test oracles, and analysis of test suites and theoretical results of testing. We examine uses of formal specifications in software testing, particularly, roles of Z specifications in software testing. We also present our unifying framework for specification-based testing, which is founded on Z.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amla N, Ammann P. Using Z specifications in category partition testing. In Proceedings of COMPASS 1992, the Seventh Annual Conference on Computer Assurance, pp 3–10, 1992.

    Chapter  Google Scholar 

  2. Brien SM, Nicholls JE. Z base standard version 1. 0. Technical report, Programming Research Group, Oxford University Computing Laboratory, Oxford University, 1992.

    Google Scholar 

  3. Cusack E, Wezeman C. Deriving tests for objects specified in Z. In Bowen JP, Nicholls JE (eds), Z User Workshop. Springer-Verlag, 1993.

    Google Scholar 

  4. Dick J, Faivre A. Automatic partition analysis of VDM specifications. Technical Report RAD/DMA/92027, Research and Advanced Development, Bull Systems Products, BULL S.A., Rue Jean Jaurès, 78340 Les Clayes-sous-Bois, France, 1992.

    Google Scholar 

  5. Dick J, Faivre A. Automating the generation and sequencing of test cases from model-based specifications. In Woodcock JCP, Larsen PG (eds), FME’93 Industrial Strength Formal Methods, Lecture Notes in Computer Science 670, pp 268–284. Springer-Verlag, 1993.

    Chapter  Google Scholar 

  6. Duke R, King P, Rose G, Smith G. The Object-Z specification language version 1. Technical Report 91–1, Software Verification Research Centre, The University of Queensland, Queensland 4072, Australia, 1991.

    Google Scholar 

  7. Hall PAV. Towards testing with respect to formal specifications. In Second IEE/BCS Conference on Software Engineering 88, pp 159–163. IEE, 1988.

    Google Scholar 

  8. Hall PAV. Relationship between specifications and testing. Information and Software Technology, 33 (1): 47–52, 1991.

    Article  Google Scholar 

  9. Hayes IJ. Specification directed module testing. IEEE Transactions on Software Engineering, 12 (1): 124–133, 1986.

    MATH  Google Scholar 

  10. Laycock G. Formal specification and testing: A case study. Journal of Software Testing, Verification and Reliability, 2 (1): 7–23, 1992.

    Article  MathSciNet  Google Scholar 

  11. Myers GJ. The Art of Software Testing. Business data processing. WileyInterscience, 1979.

    Google Scholar 

  12. Ostrand TJ, Balcer MJ. The category-partition method for specifying and generating functional tests. Communications of the ACM, 31 (6): 676–686, 1988.

    Article  Google Scholar 

  13. Richardson DJ, Aha SL, O’Malley TO. Specification-based test oracles for reactive systems. In Proceedings of the 14th International Conference on Software Engineering, pp 105–118, 1992.

    Google Scholar 

  14. Richardson DJ, O’Malley O, Tittle C. Approaches to specification-based testing. Software Engineering Notes, 14(8):86–96, 1989. Proceedings of the ACM SIGSOFT ‘89 Third Symposium on Software Testing, Analysis, and Verification (TAV3).

    Article  Google Scholar 

  15. Spivey JM. The Z Notation: A Reference Manual. Series in Computer Science. Prentice Hall International, second edition, 1992.

    Google Scholar 

  16. Stocks P. Applying formal methods to software testing. PhD thesis, The University of Queensland, 1993. ( Under examination).

    Google Scholar 

  17. Stocks P, Carrington DA. Test template framework: A specification-based testing case study. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA’93), pp 11–18, 1993.

    Google Scholar 

  18. Stocks P, Carrington DA. Test templates: A specification-based testing framework. In Proceedings of the 15th International Conference on Software Engineering, pp 405–414, 1993.

    Chapter  Google Scholar 

  19. Wezeman CD. The CO-OP method for compositional derivation of canonical testers. In Brinksma E, Scollo G, Vissers CA (eds), Protocol Specification, Testing and Verification IX. North Holland, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1994 British Computer Society

About this paper

Cite this paper

Carrington, D., Stocks, P. (1994). A tale of two paradigms: Formal methods and software testing. In: Bowen, J.P., Hall, J.A. (eds) Z User Workshop, Cambridge 1994. Workshops in Computing. Springer, London. https://doi.org/10.1007/978-1-4471-3452-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-3452-7_4

  • Publisher Name: Springer, London

  • Print ISBN: 978-3-540-19884-0

  • Online ISBN: 978-1-4471-3452-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics