Skip to main content
SpringerLink
Log in

A Novel Approach to Test Case Prioritization for Software Regression Tests

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2021 (ICCSA 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12955))

Included in the following conference series:

Abstract

Regression testing of a comprehensive software system is very costly and time-consuming. Test prioritization techniques are used to reduce the time and cost spent in regression tests. Data such as various software quality metrics and past test run results are used when prioritizing test cases in the literature. In this study, a new test prioritization method is proposed based on the number and speed of detected errors. Applying the proposed technique aims to see the errors in the system as soon as possible. In our method, historical test data is analyzed to prioritize test cases. The extent to which the analysis focuses on the recent and distant past is controlled by the parameter. For each test case; prioritization is made based on the number of detected errors and the speed of error detection. We observe its effectiveness by applying our method on regression testing for a developer performance portal software. The experimental study shows that the proposed method is valid, and the results are promising. Our approach improves the error detection rate of test sets. This improvement can be applied even in the most complex situations. With the advancement in the error detection rate, the cost and effort spent on regression tests are also reduced.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Patel, K.M., et al.: A study of regression testing for trade me website. In: CS & IT Conference Proceedings. CS & IT Conference Proceedings (2021)

    Google Scholar 

  2. Rothermel, G., et al.: Test case prioritization: an empirical study. In: Proceedings IEEE International Conference on Software Maintenance-1999 (ICSM 1999). Software Maintenance for Business Change (Cat. No. 99CB36360), pp. 179–188. IEEE (1999)

    Google Scholar 

  3. Elbaum, S., Malishevsky, A.G., Rothermel, G.: Test case prioritization: a family of empirical studies. IEEE Trans. Softw. Eng. 28(2), 159–182 (2002)

    Article  Google Scholar 

  4. Testinium Homepage. http://www.testinium.com. Accessed 17 May 2021

  5. Kurt, D., Sözer, H.: Geçmişe dönük hata tespit oranlarının zamanla değişen etkisine göre regresyon testlerinin önceliklendirilmesi. In: CEUR Workshop Proceedings. CEUR-WS (2014)

    Google Scholar 

  6. Ansari, A., et al.: Optimized regression test using test case prioritization. Procedia Comput. Sci. 79, 152–160 (2016)

    Article  Google Scholar 

  7. Alazzam, I., Nahar, K.M.O.: Combined source code approach for test case prioritization. In: Proceedings of the 2018 International Conference on Information Science and System, pp. 12–15 (2018)

    Google Scholar 

  8. Muthusamy, T., Seetharaman, K.: Effectiveness of test case prioritization techniques based on regression testing. Int. J. Softw. Eng. Appl. 5(6), 113 (2014)

    Google Scholar 

  9. Staats, M., Loyola, P., Rothermel, G.: Oracle-centric test case prioritization. In: IEEE 23rd International Symposium on Software Reliability Engineering, vol. 2012, pp. 311–320. IEEE (2012)

    Google Scholar 

  10. Raju, S., Uma, G.V.: An efficient method to achieve effective test case prioritization in regression testing using prioritization factors. Asian J. Inf. Technol. 11(5), 169–180 (2012)

    Article  Google Scholar 

  11. Shahid, M., Ibrahim, S.: A new code based test case prioritization technique. Int. J. Softw. Eng. Appl. 8(6), 31–38 (2014)

    Google Scholar 

  12. Zhang, L., et al.: Bridging the gap between the total and additional test-case prioritization strategies. In: 2013 35th International Conference on Software Engineering (ICSE), pp. 192–201. IEEE (2013)

    Google Scholar 

  13. Yoon, M., et al.: A test case prioritization through correlation of requirement and risk. J. Softw. Eng. Appl. 5(10), 823 (2012)

    Article  Google Scholar 

  14. Misra, S., Adewumi, A., Maskeliūnas, R., Damaševičius, R., Cafer, F.: Unit testing in global software development environment. In: Panda, B., Sharma, S., Roy, N.R. (eds.) REDSET 2017. CCIS, vol. 799, pp. 309–317. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-8527-7_25

    Chapter  Google Scholar 

  15. Aljawabrah, N., et al.: Automated recovery and visualization of test-to-code traceability (TCT) links: an evaluation. IEEE Access 9, 40111–40123 (2021)

    Article  Google Scholar 

  16. Jonathan, O., Omoregbe, N., Misra, S.: Empirical comparison of cross-validation and test data on internet traffic classification methods. In: Journal of Physics: Conference Series, p. 012044. IOP Publishing (2019)

    Google Scholar 

  17. Jatana, N., Suri, B., Misra, S., Kumar, P., Choudhury, A.R.: Particle swarm based evolution and generation of test data using mutation testing. In: Gervasi, O., et al. (eds.) ICCSA 2016. LNCS, vol. 9790, pp. 585–594. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42092-9_44

    Chapter  Google Scholar 

  18. Singhal, S., Suri, B., Misra, S.: An empirical study of regression test suite reduction using MHBG\_TCS tool. In: Proceedings International Conference Computation Network Information (ICCNI), pp. 1–5 (2017)

    Google Scholar 

  19. Nawar, M.N., Ragheb, M.M.: Multi-heuristic based algorithm for test case prioritization. In: Murgante, B., et al. (eds.) ICCSA 2014. LNCS, vol. 8583, pp. 449–460. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09156-3_32

    Chapter  Google Scholar 

  20. Lin, X., et al.: Test case minimization for regression testing of composite service based on modification impact analysis. In: Wang, G., Lin, X., Hendler, J., Song, W., Xu, Z., Liu, G. (eds.) WISA 2020. LNCS, vol. 12432, pp. 15–26. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60029-7_2

    Chapter  Google Scholar 

  21. Arora, P.K., Bhatia, R.: A systematic review of agent-based test case generation for regression testing. Arabian J. Sci. Eng. 43(2), 447–470 (2018)

    Article  Google Scholar 

  22. Onoma, A.K., et al.: Regression testing in an industrial environment. Commun. ACM 41(5), 81–86 (1998)

    Article  Google Scholar 

  23. Malishevsky, A.G., et al.: Cost-cognizant test case prioritization. Technical Report TR-UNL-CSE-2006-0004, University of Nebraska-Lincoln (2006)

    Google Scholar 

  24. Hao, D., et al.: A unified test case prioritization approach. ACM Trans. Softw. Eng. Methodol. (TOSEM) 24(2), 1–31 (2014)

    Article  Google Scholar 

  25. Jeffrey, D., Gupta, N.: Test case prioritization using relevant slices. In: 30th Annual International Computer Software and Applications Conference (COMPSAC 2006), pp. 411–420. IEEE (2006)

    Google Scholar 

  26. Jiang, B., et al.: Adaptive random test case prioritization. In: 2009 IEEE/ACM International Conference on Automated Software Engineering, pp. 233–244. IEEE (2009)

    Google Scholar 

  27. Rothermel, G., et al.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27(10), 929–948 (2001)

    Article  Google Scholar 

  28. Aktas, M.S., Kapdan, M.: Structural code clone detection methodology using software metrics. Int. J. Softw. Eng. Knowl. Eng. 26(2), 307–332 (2016)

    Article  Google Scholar 

  29. Aktas, M.S., Kapdan, M.: Implementation of analytical hierarchy process in detecting structural code clones. In: The 17th International Conference on Computational Science and its Applications (ICCSA 2017) (2017)

    Google Scholar 

  30. Ozturk, S., et al.: Test case prioritization related to code quality. In: The 2013 International Conference on Software Engineering Research and Practice (SERP-13) (2013)

    Google Scholar 

  31. Uygun, Y., et al.: On the large-scale graph data processing for user interface testing in big data science projects. In: 2020 IEEE Big Data, 6th International Workshop to Improve Big Data Science Project Team Processes (2020)

    Google Scholar 

  32. Tekin, C., et al.: Opinion mining on usability testing data. In: IEEE SIU Conference, Gaziantep, Turkey (2020)

    Google Scholar 

  33. Akpinar, P., et al.: Web application testing with model based testing method: case study. In: 2nd International Conference on Electrical, Communication and Computer Engineering, Turkey (2020)

    Google Scholar 

  34. Kapdan, M., Aktas, M., Yigit, M.: On the structural code clone detection problem: a survey and software metric based approach. In: ICCSA 2014: Computational Science and its Applications - ICCSA 2014, pp. 492–507 (2014)

    Google Scholar 

  35. Guveyi, E., Aktas, M., Kalipsiz, O.: Human factor on software quality: a systematic literature review. In: ICCSA 2020: Computational Science and its Applications - ICCSA 2020 (2020)

    Google Scholar 

  36. Guveyi, E., Aktas, M., Kalipsiz, O.: Impact of personal factors on software quality. In: UYMS 2020 (2020)

    Google Scholar 

Download references

Acknowledgment

We thank Saha Bilgi Teknolojileri Egitim Danismanlık San. Tic. A.S. R&D Center for providing the computational facilities that made this study possible.

Author information

Authors and Affiliations

  1. Yildiz Technical University, Istanbul, Turkey

    Tulin Boyar, Mert Oz & Mehmet S. Aktas

  2. Research and Development Center, Testinium, Istanbul, Turkey

    Ekin Oncu

Authors
  1. Tulin Boyar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mert Oz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ekin Oncu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mehmet S. Aktas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tulin Boyar .

Editor information

Editors and Affiliations

  1. University of Perugia, Perugia, Italy

    Osvaldo Gervasi

  2. University of Basilicata, Potenza, Potenza, Italy

    Beniamino Murgante

  3. Covenant University, Ota, Nigeria

    Sanjay Misra

  4. University of Cagliari, Cagliari, Italy

    Chiara Garau

  5. University of Cagliari, Cagliari, Italy

    Ivan Blečić

  6. Monash University, Clayton, VIC, Australia

    David Taniar

  7. Kyushu Sangyo University, Fukuoka, Japan

    Bernady O. Apduhan

  8. University of Minho, Braga, Portugal

    Ana Maria A. C. Rocha

  9. Polytechnic University of Bari, Bari, Italy

    Eufemia Tarantino

  10. Polytechnic University of Bari, Bari, Italy

    Carmelo Maria Torre

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Boyar, T., Oz, M., Oncu, E., Aktas, M.S. (2021). A Novel Approach to Test Case Prioritization for Software Regression Tests. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2021. ICCSA 2021. Lecture Notes in Computer Science(), vol 12955. Springer, Cham. https://doi.org/10.1007/978-3-030-87007-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87007-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87006-5

  • Online ISBN: 978-3-030-87007-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation