Skip to main content
SpringerLink
Log in

AHR: Human-Centred Aspects of Test Design

  • Conference paper
  • First Online:
Evaluation of Novel Approaches to Software Engineering (ENASE 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 703))

Abstract

To apply model-based testing successfully and effectively, a complete, coherent and easy-to-read model of a system has to be constructed. If the model is incomplete, inconsistent or inaccurate due to human error, the corresponding test development becomes useless or even dangerous: the developers might rely on the test results that do not correctly reflect the actual system-under-test. In this chapter we discuss human-centred aspects of model-based test design, focusing on combinatorial testing. These aspects are implemented within a formal framework for combinatorial test design. The framework is called AHR by its core features: Agile, Human-centred and Refinement-oriented. The goal of the framework is to provide a human-centered iterative, refinement-based construction of system models and the corresponding test plans, as well as to supports reuse and refinement of the developed test plans at different levels of abstraction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Blech, J.O., Spichkova, M., Peake, I., Schmidt, H.: Cyber-virtual systems: simulation, validation & visualization. In: Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2014) (2014)

    Google Scholar 

  2. Broy, M.: Service-oriented systems engineering: specification and design of services and layered architectures. In: Broy, M., Grünbauer, J., Harel, D., Hoare, T. (eds.) Engineering Theories of Software Intensive Systems. The JANUS Approach, vol. 195, pp. 47–81. Springer, Dordrecht (2005)

    Chapter  Google Scholar 

  3. Dalal, S.R., Jain, A., Karunanithi, N., Leaton, J., Lott, C.M., Patton, G.C., Horowitz, B.M.: Model-based testing in practice. In: Proceedings of the 21st International Conference on Software Engineering, pp. 285–294. ACM (1999)

    Google Scholar 

  4. Farchi, E., Segall, I., Tzoref-Brill, R.: Using projections to debug large combinatorial models. In: Proceedings of the International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 311–320. IEEE (2013)

    Google Scholar 

  5. Farchi, E., Segall, I., Tzoref-Brill, R., Zlotnick, A.: Combinatorial testing with order requirements. In: Proceedings of the International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 118–127. IEEE (2014)

    Google Scholar 

  6. Feng, X., Parnas, D.L., Tse, T., O’Callaghan, T.: A comparison of tabular expression-based testing strategies. IEEE Trans. Softw. Eng. 37(5), 616–634 (2011)

    Article  Google Scholar 

  7. Grieskamp, W.: Multi-paradigmatic model-based testing. In: Havelund, K., Núñez, M., Roşu, G., Wolff, B. (eds.) Formal Approaches to Software Testing and Runtime Verification. LNCS, vol. 4262, pp. 1–19. Springer, Heidelberg (2006). doi:10.1007/11940197_1

    Chapter  Google Scholar 

  8. Hellmann, T.D., Sharma, A., Ferreira, J., Maurer, F.: Agile testing: past, present, and future-charting a systematic map of testing in agile software development. In: Proceedings of the Agile Conference (AGILE), pp. 55–63. IEEE (2012)

    Google Scholar 

  9. Jin, Y., Parnas, D.L.: Defining the meaning of tabular mathematical expressions. Sci. Comput. Program. 75(11), 980–1000 (2010)

    Article  MATH  Google Scholar 

  10. Kuhn, D.R., Wallace, D.R., Gallo, A.M.: Software fault interactions and implications for software testing. IEEE Trans. Softw. Eng. 30(6), 418–421 (2004)

    Article  Google Scholar 

  11. Kuhn, R., Kacker, R., Lei, Y., Hunter, J.: Combinatorial software testing. IEEE Comput. 42(8), 94–96 (2011)

    Google Scholar 

  12. Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. 43(2), 11:1–11:29 (2011)

    Article  MATH  Google Scholar 

  13. Pane, J., Myers, B.: Usability issues in the design of novice programming systems. School of Computer Science Technical report CMU-CS-96-132 (1996)

    Google Scholar 

  14. Pretschner, A.: Model-based testing in practice. In: Fitzgerald, J., Hayes, I.J., Tarlecki, A. (eds.) FM 2005. LNCS, vol. 3582, pp. 537–541. Springer, Heidelberg (2005). doi:10.1007/11526841_37

    Chapter  Google Scholar 

  15. Sapienza, G., Crnkovic, I., Seceleanu, T.: Towards a methodology for hardware and software design separation in embedded systems. In: Proceedings of the ICSEA, pp. 557–562. IARIA (2012)

    Google Scholar 

  16. Segall, I., Tzoref-Brill, R.: Interactive refinement of combinatorial test plans. In: Proceedings of the 34th International Conference on Software Engineering, pp. 1371–1374. IEEE Press (2012)

    Google Scholar 

  17. Segall, I., Tzoref-Brill, R., Zlotnick, A.: Common patterns in combinatorial models. In: Proceedings of the International Conference on Software Testing, Verification and Validation (ICST), pp. 624–629. IEEE (2012)

    Google Scholar 

  18. Spichkova, M.: Refinement-based verification of interactive real-time systems. Electron. Notes Theor. Comput. Sci. 214, 131–157 (2008)

    Article  MATH  Google Scholar 

  19. Spichkova, M.: Architecture: Requirements + Decomposition + Refinement. Softwaretechnik-Trends 31, 4 (2011)

    Google Scholar 

  20. Spichkova, M., Campetelli, A.: Towards system development methodologies: from software to cyber-physical domain. In: Proceedings of the International Workshop on Formal Techniques for Safety-Critical Systems (2012)

    Google Scholar 

  21. Spichkova, M., Zhu, X., Mou, D.: Do we really need to write documentation for a system? In: Proceedings of the International Conference on Model-Driven Engineering and Software Development (MODELSWARD 2013) (2013)

    Google Scholar 

  22. Spichkova, M.: Design of formal languages and interfaces: formal does not mean unreadable. In: Emerging Research and Trends in Interactivity and the Human-Computer Interface. IGI Global (2013)

    Google Scholar 

  23. Spichkova, M., Liu, H., Schmidt, H.: Towards quality-oriented architecture: integration in a global context. In: Proceedings of the European Conference on Software Architecture Workshops, p. 64. ACM (2015)

    Google Scholar 

  24. Spichkova, M., Zamansky, A.: A human-centred framework for combinatorial test design. In: Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering, pp. 228–233 (2016)

    Google Scholar 

  25. Spichkova, M., Zamansky, A.: A human-centred framework for supporting model-based testing. In: CAiSE 2016, pp. 105–112. CEUR (2016). http://researchbank.rmit.edu.au/view/rmit:38416, http://ceur-ws.org/Vol-1612/

  26. Spichkova, M., Zamansky, A., Farchi, E.: Towards a human-centred approach in modelling and testing of cyber-physical systems. In: Proceedings of the International Workshop on Automated Testing for Cyber-Physical Systems in the Cloud (2015)

    Google Scholar 

  27. Spichkova, M., Zamansky, A., Farchi, E.: A visual logical language for system modelling in combinatorial test design. In: Krogstie, J., Mouratidis, H., Su, J. (eds.) CAiSE 2016. LNBIP, vol. 249, pp. 116–121. Springer, Cham (2016). doi:10.1007/978-3-319-39564-7_12

    Google Scholar 

  28. Tai, K.C., Lei, Y.: A test generation strategy for pairwise testing. IEEE Trans. Softw. Eng. 28(1), 109–111 (2002)

    Article  MathSciNet  Google Scholar 

  29. Talby, D., Keren, A., Hazzan, O., Dubinsky, Y.: Agile software testing in a large-scale project. IEEE Softw. 23(4), 30–37 (2006)

    Article  Google Scholar 

  30. Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab. 22(5), 297–312 (2012)

    Article  Google Scholar 

  31. Zamansky, A., Farchi, E.: Helping the tester get it right: towards supporting agile combinatorial test design. In: Bianculli, D., Calinescu, R., Rumpe, B. (eds.) SEFM 2015. LNCS, vol. 9509, pp. 35–42. Springer, Heidelberg (2015). doi:10.1007/978-3-662-49224-6_4

    Chapter  Google Scholar 

  32. Zhang, J., Zhang, Z., Ma, F.: Introduction to combinatorial testing. In: Zhang, J., Zhang, Z., Ma, F. (eds.) Automatic Generation of Combinatorial Test Data, pp. 1–16. Springer, Heidelberg (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Science (Computer Science and IT), RMIT University, 414-418 Swanston Street, Melbourne, 3001, Australia

    Maria Spichkova

  2. Information Systems Department, University of Haifa, Carmel Mountain, 31905, Haifa, Israel

    Anna Zamansky

Authors
  1. Maria Spichkova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anna Zamansky
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Spichkova .

Editor information

Editors and Affiliations

  1. Wrocław University of Economics, Wrocław, Poland

    Leszek A. Maciaszek

  2. INSTICC and Instituto Politécnico de Setúbal, Setúbal, Portugal

    Joaquim Filipe

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Spichkova, M., Zamansky, A. (2016). AHR: Human-Centred Aspects of Test Design. In: Maciaszek, L., Filipe, J. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2016. Communications in Computer and Information Science, vol 703. Springer, Cham. https://doi.org/10.1007/978-3-319-56390-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56390-9_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56389-3

  • Online ISBN: 978-3-319-56390-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation