Skip to main content
SpringerLink
Log in

Hybrid test language processing based framework for test case optimization

  • Original Research
  • Published:
CSI Transactions on ICT Aims and scope Submit manuscript

Abstract

One of the major problems of software industry is its inability to develop error free software. Approximately 40–50 % of SDLC cost is spent on software testing. When applications need to be developed rapidly with changing user demands, this expenditure takes a significant value. Software testing is very important but is an effort consuming activity. Large numbers of test cases are possible and some of them may make software fail. Therefore there is a need to automate the existing manual approach to minimize the test case execution time and further optimize test cases. In this paper a keyword oriented data driven hybrid framework—HTLP (hybrid test language processing) been proposed for automatic test case execution and optimization. The HTLP is applied to an open source software based application-Vtiger CRM5. The proposed framework is compared with manual testing approach for test case execution and optimization. Based on experimental results it is concluded that (1) with iterative regression cycles the HTLP testing time is significantly very low as compared to manual testing approach and (2) a high level of test suite optimization (83.78 %) is achieved using the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Singh Y (2012) Software testing. Cambridge University Press, Cambridge, pp 38–40

    Google Scholar 

  2. Boujarwah AS, Saleh K (1997) Compiler test case generation methods: a survey and assessment. Inf Softw Technol 39(9):617–625

    Article  Google Scholar 

  3. http://www.internetjournals.net/journals/tir/2009/January/Paper%2006.pdf. Accessed May 2014

  4. Nidhra S, Dondeti J (2012) Black box and white box testing techniques—a literature review. Int J Embed Syst Appl 2(2):29–50

    Google Scholar 

  5. Keane I, Rota WP (2006) ROI on test automation. http://www.ispe.org/pe-ja/roi-of-test-automation. Accessed Nov 2014

  6. Ramamoorthy C, Ho S, Chen W (1973) On the automated generation of program test data. IEEE Trans Softw Eng 2(4):293–300

    Google Scholar 

  7. Dustin E, Rashka J, Paul J (1999) Automated software testing. Addison-Wesley, Boston

    Google Scholar 

  8. Sangwan OP, Bhatia PK, Singh Y (2001) Radial basis function neural network based approach to test oracle. ACM SIGSOFT Softw Eng Notes 36(5):1–5

    Article  Google Scholar 

  9. Bicevskis J, Borzovs J, Straujums U, Zarins A, Miller E (1979) SMOTL—a system to construct samples for data processing pro-gram debugging. IEEE Trans Softw Eng 5(1):60–66

    Article  MATH  Google Scholar 

  10. Zallar K (2001) Are you ready for the test automation game? Softw Test Qual Eng 3(6):22–26

    Google Scholar 

  11. Fewster M, Graham D (1999) Software test automation. Addison-Wesley, Boston

    MATH  Google Scholar 

  12. Neha C, Sangwan OP, Arora R (2014) Event-coverage and weight based method for test suite prioritization. Int J Inf Technol Comput Sci 6(12):61–66

    Google Scholar 

  13. Software test analyst. http://olaiainforarch.wordpress.com/category/test-process/. Accessed Apr 2014

  14. Mann M, Sangwan OP (2015) Generating and prioritizing optimal paths using ant colony optimization. Comput Ecol Softw 5(1):1–15

    Google Scholar 

  15. Aggarwal KK, Singh Y, Kaur A, Sangwan OP (2004) A neural net based approach to test oracle. ACM SIGSOFT Softw Eng Notes 29(3):1–6

    Article  Google Scholar 

  16. Neha C, Sangwan OP, Singh Y (2012) Test case prioritization using fuzzy logic for GUI based software. Proc Int J Adv Comput Sci Appl 3(12):222–227

    Google Scholar 

  17. Mann M, Sangwan OP (2014) Test case prioritization using Cuscuta search. Netw Biol 4(4):179–192

    Google Scholar 

  18. Boyer R, Elspas B, Levitt K (1975) SELECT—a formal system for testing and debugging programs by symbolic execution. SIGPLAN Not 10(6):234–245

    Article  Google Scholar 

  19. Johnson R, Foote B (1998) Designing reusable classes. J Object Oriented Progr 1(2):22–35

    Google Scholar 

  20. Grieskamp W, Gurevich Y, Schulte W, Veanes M (2002) Generating finite state machines from abstract state machines. In: ISSTA

  21. Quick Test Professional (2010) QTP helps documentation. Available with QTP 10.00 Version. Accessed March 2014

  22. Biswas S, Mall R, Satpathy M, Sukumaran S (2011) Regression test selection techniques: a survey. Informatica 35:289–321

    Google Scholar 

  23. Mann M, Sangwan OP (2013) Test language processing: a novel approach for automated software testing. Softw Eng Int J 3(2):29–34

    Google Scholar 

  24. http://sourceforge.net/projects/vtigercrm/files/vtiger%20CRM%20Release%20Archive/vtiger%20CRM%205/. Accessed May 2013

  25. Gavetter FJ, Larry BW (2006) Correlation. In: Statistics for behavioral sciences, 7th edn. Wadsworth Publishing, pp 519–561

  26. Harrold M, Rothermel G (1994) Performing data flow testing on classes. In: Proceedings of the 2nd ACM SIGSOFT symposium on Foundations of software engineering, pp 154–163

  27. Harrold M, Soffa M (1989) Interprocedural data flow testing. In: Proceedings of the ACM SIGSOFT’89 third symposium on software testing, analysis, and verification, pp 158–167

  28. Gupta R, Harrold M, Soffa M (1996) Program slicing-based regression testing techniques. J Softw Test Verif Reliab 2:83–112

    Article  Google Scholar 

  29. Taha A, Thebaut S, Liu S (1989) An approach to software fault localization and revalidation based on incremental data flow analysis. In: Proceedings of the 13th annual international computer software and applications conference, pp 527–534

  30. Binkley D (1997) Semantics guided regression test cost reduction. IEEE Trans Softw Eng 23(8):498–516

    Article  Google Scholar 

  31. Agrawal H, Horgan J, Krauser E, London S (1993) Incremental regression testing. In: IEEE international conference on software maintenance, pp 348–357

  32. Bates S, Horwitz S (1993) Incremental program testing using program dependence graphs. In: Conference record of 20th ACM SIGPLAN-SIGACT symposium on principles of programming languages, pp 384–396

  33. Leung H, White L (1992) A firewall concept for both control-flow and data-flow in regression integration testing. In: Proceedings of the conference on software maintenance, pp 262–270

  34. Leung H, White L (1990) A study of integration testing and software regression at the integration level. In: Proceedings of the conference on software maintenance, pp 290–300

  35. Chen Y, Rosenblum D, Vo K (1994) TestTube: a system for selective regression testing. In: Proceedings of the 16th international conference on software engineering, pp 211–222

  36. Vokolos F, Frankl P (1997) Pythia: a regression test selection tool based on textual differencing. In: Proceedings of the 3rd international conference on reliability, quality & safety of software-intensive systems (ENCRESS’ 97), pp 3–21

  37. Vokolos F, Frankl P (1998) Empirical evaluation of the textual differencing regression testing technique. In: ICSM’98: proceedings of the international conference on software maintenance, pp 44–53

  38. Zhao J, Xie T, Li N (2006) Towards regression test selection for AspectJ programs. In: Proceedings of the 2nd workshop on testing aspect-oriented programs (WTAOP’06), pp 21–26

  39. Rothermel G, Harrold M (1997) A safe, efficient regression test selection technique. ACM Trans Softw Eng Methodol 6(2):173–210

    Article  Google Scholar 

  40. Xu L, Xu B, Chen Z, Jiang J, Chen H (2003) Regression testing for web applications based on slicing. In: Proceedings of the 27th annual international computer software and applications conference (COMPSAC 2003), Los Alamitos, CA, USA, pp 652–656

  41. Ruth M, Oh S, Loup A, Horton B et al (2007) Towards automatic regression test selection for web services. In: Proceedings of the 31st annual international computer software and applications conference, vol 2, pp 729–736

  42. Willmor D, Embury S (2005) A safe regression test selection technique for database-driven applications. In: Proceedings of the 21st IEEE international conference on software maintenance. IEEE Computer Society, pp 421–430

  43. Haraty R, Mansour N, Daou B (2004) Advanced topics in database research, volume 3, chapter regression test selection for database applications, pp 141–165

  44. Tarhini A, Fouchal H, Mansour N (2006) Regression testing web services-based applications. In: AICCSA’06 proceedings of the IEEE international conference on computer systems and applications. IEEE Computer Society, pp 163–170

  45. Lin F, Ruth M, Tu S (2006) Applying safe regression test selection techniques to Java web services. In: International conference on next generation Web services practices. IEEE Computer Society, Los Alamitos, CA, USA, pp 133–142

  46. Ruth M, Tu S (2007) A safe regression test selection technique for web services. In: Proceedings of the second international conference on Internet and Web applications and services

  47. Xu G, Rountev A (2007) Regression test selection for AspectJ software. In: ICSE’07: proceedings of the 29th international conference on software engineering, pp 65–74

Download references

Acknowledgments

This work was supported by university grant commission (UGC), Government of India for Doctoral Research Study under Grant No. F./201415/NFO201415OBCDEL16123. The authors are very grateful to the anonymous reviewers for providing valuable and detailed comments that have greatly improved the paper.

Author information

Authors and Affiliations

  1. School of Information and Communication Technology, Gautam Buddha University, Greater Noida, Uttar Pradesh, India

    Mukesh Mann & Pradeep Tomar

  2. Department of Computer Science and Engineering, Guru Jambheshwar University of Science and Technology, Hisar, Haryana, India

    Om Prakash Sangwan

Authors
  1. Mukesh Mann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Om Prakash Sangwan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pradeep Tomar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mukesh Mann.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mann, M., Sangwan, O.P. & Tomar, P. Hybrid test language processing based framework for test case optimization. CSIT 3, 71–81 (2015). https://doi.org/10.1007/s40012-015-0073-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40012-015-0073-9

Keywords

Search

Navigation