Skip to main content
SpringerLink
Log in

A Comparative Study of Software Testing Techniques

  • Conference paper
  • First Online:
Networked Systems (NETYS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 10299))

Included in the following conference series:

Abstract

Nowadays, software systems have become an essential element in our daily life. To ensure the quality and operation of software, testing activities have become primordial in the software development life cycle (SDLC). Indeed, software bugs can potentially cause dramatic consequences if the product is released to the end user without testing. The software testing role is to verify that the actual result and the expected result are consistent and ensure that the system is delivered without bugs. Many techniques, approaches and tools have been proposed to help check that the system is defect free. In this paper, we highlight two software testing techniques considered among the most used techniques to perform software tests, and then we perform a comparative study of these techniques, the approaches that supports studied techniques, and the tools used for each technique. We have selected the first technique based on the 2014 survey [62] that heighted the motivations for using the Model-based-testing, and by analyzing the survey results we have found that some MBT limits are benefits in Risk based testing, the second technique in our study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pretschner, A.: Model-based-testing. In: ICSE, pp. 722–732 (2005)

    Google Scholar 

  2. Utting, M., Pretschner, A., Legeard, B.: A Taxonomy of Model-Based Testing, a School of Computing and Mathematical Sciences (2006)

    Google Scholar 

  3. Alam, M.M.: Risk-based testing techniques: a perspective study. Int. J. Comput. Appl. 65, 33–41 (2013). (0975–8887)

    Google Scholar 

  4. Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. ACM, Inc. (2017)

    Google Scholar 

  5. Erdogan, G.: Approaches for the combined use of risk analysis and testing: a systematic literature review. Int. J. Softw. Tools Technol. Transfer 16, 627–642 (2014). Springer-Verlag Berlin Heidelberg

    Article  Google Scholar 

  6. Felderer, M.: A classification for model-based security testing. In: The Third International Conference on Advances in System Testing and Validation Lifecycle (2011)

    Google Scholar 

  7. Felderer, M.: A taxonomy of risk-based testing. Int. J. Softw. Tools Technol. Transfer 16, 559–568 (2014)

    Article  Google Scholar 

  8. Micskei, Z.: Model-Based Testing (MBT), Online Dictionary. http://mit.bme.hu/~micskeiz/pages/modelbased_testing.html

  9. Palanivel, M., Selvadurai, K.: Risk-driven security testing using risk analysis with threat modeling approach, Palanivel and Selvadurai SpringerPlus (2014)

    Google Scholar 

  10. Hartman, A.: AGEDIS: Model-Based Test Generation Tools, January 2009. http://www.agedis.de

  11. Dranidis, D.: JSXM: a tool for automated test generation. In: Proceeding SEFM 2012 Proceedings of the 10th International Conference on Software Engineering and Formal Methods (2012)

    Google Scholar 

  12. Aichernig, B.: MoMuT: UML model-based mutation testing for UML. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015)

    Google Scholar 

  13. Pretschner, A.: One evaluation of model-based testing and its automation. In: ICSE 2005, 15–21 May 2005

    Google Scholar 

  14. Kristoffer, L.: A Software Tool for Risk-based Testing. http://www.idi.ntnu.no/grupper/su/fordypningsprosjekt2004/Jorgensen2004.pdf

  15. Dalal, S.R., Jain, A., Karunanithi, N.: Model-based testing in practice. In: ICSE 1999, May 1999

    Google Scholar 

  16. Dias Neto, A.C., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: WEASEL Tech 2007, November 2007

    Google Scholar 

  17. Cristi, M.: Using {log} as a Test Case Generator for Z Specifications. GNCS project PICT 2011-1002

    Google Scholar 

  18. Sarma, M., Murthy, P.V.R.: Model-based testing in industry – a case study with two MBT tools. ACM, 2–8 May 2010

    Google Scholar 

  19. Dias Neto, A.C., Travassos, G.H.: Characterization of model-based software testing approaches, Technical report at PESC/COPPE/UFRJ, Brazil, Published August 2007

    Google Scholar 

  20. Amland, S.: Risk-based testing: risk analysis fundamentals and metrics for software testing including a financial application case study. J. Syst. Softw. 53, 287–295 (2000)

    Article  Google Scholar 

  21. Felderer, M., Haisjackl, C., Breu, R., Motz, J.: Integrating manual and automatic risk assessment for risk-based testing. In: Biffl, S., Winkler, D., Bergsmann, J. (eds.) SWQD 2012. LNBIP, vol. 94, pp. 159–180. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27213-4_11

    Chapter  Google Scholar 

  22. Felderer, M., Ramler, R.: Experiences and challenges of introducing risk-based testing in an industrial project. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2013. LNBIP, vol. 133, pp. 10–29. Springer, Heidelberg (2013). doi:10.1007/978-3-642-35702-2_3

    Chapter  Google Scholar 

  23. Redmill, F.: Exploring risk-based testing and its implications. Softw. Test. Verif. Reliab. 14, 3–15 (2004)

    Article  Google Scholar 

  24. Redmill, F.: Theory and practice of risk-based testing. Softw. Test. Verif. Reliab. 15, 3–20 (2005)

    Article  Google Scholar 

  25. Yoon, H., Choi, B.: A test case prioritization based on degree of risk exposure and its empirical study. Int. J. Softw. Eng. Knowl. Eng. 21, 191–209 (2011)

    Article  Google Scholar 

  26. Gleirscher, M.: Hazard-based selection of test cases. In: Proceeding if the Sixth International Workshop on Automation of Software Test (AST 2011), pp. 64–70. ACM, New York (2011)

    Google Scholar 

  27. Gleirscher, M.: Hazard analysis for technical systems. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2013. LNBIP, vol. 133, pp. 104–124. Springer, Heidelberg (2013). doi:10.1007/978-3-642-35702-2_8

    Chapter  Google Scholar 

  28. Ray, M., Mohapatra, D.P.: Risk analysis: a guiding force in the improvement of testing. IET Softw. 7, 29–46 (2013)

    Article  Google Scholar 

  29. Kloos, J., Hussain, T., Eschbach, R.: Risk-based testing of safetycritical embedded systems driven by fault tree analysis. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2011), pp. 26–33. IEEE, New York (2011)

    Google Scholar 

  30. Nazier, R., Bauer, T.: Automated risk-based testing by integrating safety analysis information into system behavior models. In: Proceeding of the 23rd International Symposium on Software Reliability Engineering Workshops (ISSREW 2012), pp. 213–218. IEEE, New York (2012)

    Google Scholar 

  31. Wendland, M.-F., Kranz, M., Schieferdecker, I.: A systematic approach to risk-based testing using risk-annotated requirements models. In: Proceeding of the Seventh International Conference on Software Engineering Advances (ICSEA 2012), pp. 636–642. IARA (2012)

    Google Scholar 

  32. Xu, D., Tu, M., Sandford, M., Thomas, L., Woodraska, D., Xu, W.: Automated security test generation with formal threat models. IEEE Trans. Dependable Secure Comput. 9, 526–540 (2012)

    Article  Google Scholar 

  33. Zimmermann, F., Eschbach, R., Kloos, J., Bauer, T.: Risk-based statistical testing: a refinement-based approach to the reliability analysis of safety-critical systems. In: Proceeding of the 12th European Workshop on Dependable Computing (EWDC 2009), pp. 1–8 (2009)

    Google Scholar 

  34. Chen, Y., Probert, R.L.: A risk-based regression test selection strategy. In: Proceeding of the 14th IEEE International Symposium on Software Reliability Engineering (ISSRE 2003), Fast Abstract, pp. 305–306. Chillarege Press (2003)

    Google Scholar 

  35. Chen, Y., Probert, R.L., Sims, D.P.: Specification-based regression test selection with risk analysis. In: Proceeding of the 2002 Conference of the Centre for Advanced Studies on Collaborative Research (CASCON 2002), pp. 1–14. IBM Press, New York (2002)

    Google Scholar 

  36. Entin, V., Winder, M., Zhang, B., Christmann, S.: Introducing model-based testing in an industrial scrum project. In: Proceeding of the Seventh International Workshop on Automation of Software Test (AST 2012), pp. 43–49. IEEE, New York (2012)

    Google Scholar 

  37. Stallbaum, H., Metzger, A., Pohl, K.: An automated technique for risk-based test case generation and prioritization. In: Proceeding of the Third International Workshop on Automation of Software Test (AST 2008), pp. 67–70. ACM, New York (2008)

    Google Scholar 

  38. Hosseingholizadeh, A.: A source-based risk analysis approach for software test optimization. In: Proceeding of the Second International Conference on Computer Engineering and Technology (ICCET 2010), vol. 2, pp. 601–604. IEEE, New York (2010)

    Google Scholar 

  39. Wong, W.E., Qi, Y., Cooper, K.: Source code-based software risk assessing. In: Proceeding of the 2005 ACM Symposium on Applied Computing (SAC 2005), pp. 1485–1490. ACM, New York (2005)

    Google Scholar 

  40. Kumar, N., Sosale, D., Konuganti, S.N., Rathi, A.: Enabling the adoption of aspects-testing aspects: A risk model, fault model and patterns. In: Proceeding of the Eighth ACM International Conference on Aspect-Oriented Software Development (AOSD 2009), pp. 197–206. ACM, New York (2009)

    Google Scholar 

  41. Rosenberg, L., Stapko, R., Gallo, A.: Risk-based object oriented testing. In: Proceeding of the 24th Annual Software EngineeringWorkshop, pp. 1–6. NASA, Software Engineering Laboratory (1999)

    Google Scholar 

  42. Bai, X., Kenett, R.S.: Risk-based adaptive group testing of semantic web services. In: Proceeding of the 33rd Annual IEEE International Computer Software and Applications Conference (COMPSAC 2009), vol. 2, pp. 485–490. IEEE, New York (2009)

    Google Scholar 

  43. Bai, X., Kennett, R.S., Yu, W.: Risk assessment and adaptive group testing of semantic web services. Int. J. Softw. Eng. Knowl. Eng. 22, 595–620 (2012)

    Article  Google Scholar 

  44. Casado, R., Tuya, J., Younas, M.: Testing long-lived web services transactions using a risk-based approach. In: Proceeding of the 10th International Conference on Quality Software (QSIC 2010), pp. 337–340. IEEE, New York (2010)

    Google Scholar 

  45. Casado, R., Tuya, J., Younas, M.: A framework to test advanced web services transactions. In: Proceeding of the 4th International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 443–446. IEEE, New York (2011)

    Google Scholar 

  46. Murthy, K.K., Thakkar, K.R., Laxminarayan, S.: Leveraging risk based testing in enterprise systems security validation. In: Proceeding of the First International Conference on Emerging Network Intelligence (EMERGING 2009), pp. 111–116. IEEE, New York (2009)

    Google Scholar 

  47. Zech, P.: Risk-based security testing in cloud computing environments. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 411– 414. IEEE, New York (2011)

    Google Scholar 

  48. Zech, P., Felderer, M., Breu, R.: Towards risk-driven security testing of service centric systems. In: 2012 12th International Conference on Quality Software (QSIC). IEEE (2012)

    Google Scholar 

  49. Schneidewind, N.F.: Risk-driven software testing and reliability. Int. J. Reliab. Qual. Saf. Eng. 14, 99–132 (2007)

    Article  Google Scholar 

  50. Souza, E., Gusmão, C., Venâncio, J.: Risk-based testing: a case study. In: Proceeding of the Seventh International Conference on Information Technology: New Generations (ITNG 2010), pp. 1032–1037. IEEE, New York (2010)

    Google Scholar 

  51. Bach, J.: Heuristic Risk-Based Testing. Software Testing and Quality Engineering Magazine, November 1999

    Google Scholar 

  52. Paul, G.: Risk-Based E-Business Testing, pp. 3–29, 51–80 (2002). ISBN: 1580533140

    Google Scholar 

  53. Hartman, A.: The AGEDIS tools for model based testing. In: ISSTA 2004 Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (2004)

    Google Scholar 

  54. Stålhane, T.: Risk Analysis as a Prioritizing Mechanism in EuroSPI (2003)

    Google Scholar 

  55. http://promise.cin.ufpe.br/rbttool/

  56. Tretmans, J., Brinksma, E.: Côte de Resyste – automated model based testing. In: Progress 2002 – 3rd Workshop on Embedded Systems (2002)

    Google Scholar 

  57. Bouquet, F., Legeard, B., Peureux, F., Torreborre, E.: Mastering test generation from smart card software formal models. In: Proceedings of International Workshop on Construction and Analysis of Safe, Secure and Interoperable Smart devices (2004)

    Google Scholar 

  58. Anand, S., Burke, E.K., Chen, T.Y., Clark, J., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86, 1978–2001 (2013)

    Article  Google Scholar 

  59. http://unina.stidue.net/Ingegneria%20del%20Software%202/Materiale/Sommerville%20-%20Software%20Engineering%208e.pdf

  60. https://msdn.microsoft.com/en-us/library/jj159342.aspx

  61. https://www.dice.com/skills/Risk-based+testing.html

  62. Legeard, B., et al.: Model-based-Testing User Survey: Results (2014). http://model-based-testing.info/wordpress/wp-content/uploads/2014_MBT_User_Survey_Results.pdf

Download references

Author information

Authors and Affiliations

  1. Faculty of Sciences Ben M’sik, University Hassan II of Casablanca, Casablanca, Morocco

    Meriem Atifi, Abdelaziz Mamouni & Abdelaziz Marzak

Authors
  1. Meriem Atifi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdelaziz Mamouni
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdelaziz Marzak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Meriem Atifi , Abdelaziz Mamouni or Abdelaziz Marzak .

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of California, Santa Barbara, Santa Barbara, California, USA

    Amr El Abbadi

  2. Université de Lausanne, Lausanne, Switzerland

    Benoît Garbinato

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Atifi, M., Mamouni, A., Marzak, A. (2017). A Comparative Study of Software Testing Techniques. In: El Abbadi, A., Garbinato, B. (eds) Networked Systems. NETYS 2017. Lecture Notes in Computer Science(), vol 10299. Springer, Cham. https://doi.org/10.1007/978-3-319-59647-1_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59647-1_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59646-4

  • Online ISBN: 978-3-319-59647-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation