Skip to main content

Pairwise Test Suite Generation Using Adaptive Teaching Learning-Based Optimization Algorithm with Remedial Operator

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 843))

Abstract

Software systems nowadays have large configuration spaces. Pairwise test design technique is found useful by testers to sample only required configuration options of these systems for exploring errors owing to their interactions. Being a NP-complete problem, pairwise test suite generation problem has been addressed using several meta-heuristic algorithms including the Fuzzy Adaptive Teaching Learning-based Optimization (ATLBO) algorithm in the literature. ATLBO is a recent enhanced variant of Teaching Learning-based Optimization (TLBO) algorithm that adaptively applies its search operations using a Mamdani-type fuzzy inference system. Presently, ATLBO enters into stagnation or sometimes converges abnormally after some iterations. To address this issue, this paper proposes ATLBO with a remedial operator so as to further improve its searching capabilities. To evaluate the performance of ATLBO with remedial operator, it is used in a strategy called pATLBO_RO for the pairwise test suite generation problem. Experimental results reveal the strong performance of pATLBO_RO against other meta-heuristic and hyper-heuristic based pairwise test suite generation strategies.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Myers, G.J., Sandler, C., Badgett, T.: The Art of Software Testing, 3rd edn. Wiley, Hoboken (2011)

    Google Scholar 

  2. Zamli, K.Z., Alkazemi, B.Y.: Combinatorial Testing. UMP Publisher, Pahang (2015)

    Google Scholar 

  3. Yilmaz, C., Fouch, S., Cohen, M.B., Porter, A., Demiroz, G., Koc, U.: Moving forward with combinatorial interaction testing. Computer 47(2), 37–45 (2014)

    Article  Google Scholar 

  4. Ahmed, B.S., Zamli, K.Z.: A variable-strength interaction test suites generation strategy using particle swarm optimization. J. Syst. Softw. 84(12), 2171–2185 (2011)

    Article  Google Scholar 

  5. Ahmed, B.S., Zamli, K.Z.: The development of a particle swarm based optimization strategy for pairwise testing. J. Artif. Intell. 4(2), 156–165 (2011)

    Article  Google Scholar 

  6. Alsewari, A.R.A., Zamli, K.Z.: A harmony search based pairwise sampling strategy for combinatorial testing. Int. J. Phys. Sci. 7(7), 1062–1072 (2012)

    Google Scholar 

  7. Din, F., Alsewari, A.R.A., Zamli, K.Z.: A parameter free choice function based hyper-heuristic strategy for pairwise test generation. In: Proceedings of the IEEE International Conference on Software Quality, Reliability and Security Companion, pp. 85–91. IEEE, Prague (2017)

    Google Scholar 

  8. Klaib, M., Zamli, K.Z., Isa, N., Younis, M., Abdullah, R.: G2Way a backtracking strategy for pairwise test data generation. In: Proceedings of the 15th Asia-Pacific Software Engineering Conference, pp. 463–470. IEEE, Beijing (2008)

    Google Scholar 

  9. Nasser, A.B., Alsariera, Y.A., AlSewari, A.R.A., Zamli, K.Z.: A Cuckoo Search based pairwise strategy for combinatorial testing problem. J. Theor. Appl. Inf. Technol. 82(1), 154–162 (2015)

    Google Scholar 

  10. Nasser, A.B., Alsewari, A.A., Tairan, N.M., Zamli, K.Z.: Pairwise test data generation based on flower pollination algorithm. Malay. J. Comput. Sci. 30(3), 242–257 (2017)

    Article  Google Scholar 

  11. Othman, R.R., Zamli, K.Z.: ITTDG: integrated t-way test data generation strategy for interaction testing. Sci. Res. Essays 6(17), 3638–3648 (2011)

    Article  Google Scholar 

  12. Younis, M.I., Zamli, K.Z., Isa, N.A.M.: MIPOG-modification of the IPOG strategy for t-way software testing. In: Proceedings of the Distributed Frameworks and Applications, pp. 1–6. IEEE, Beijing (2008)

    Google Scholar 

  13. Younis, M.I., Zamli, K.Z., Isa, N.A.M.: Algebraic strategy to generate pairwise test set for prime number parameters and variables. In: Proceedings of the International Symposium on Information Technology, pp. 1–4. IEEE, Kuala Lumpur (2008)

    Google Scholar 

  14. Zamli, K.Z., Din, F., Ahmed, B.S., Bures, M.: A hybrid q-learning sine-cosine-based strategy for addressing the combinatorial test suite minimization problem. PLoS ONE 13(5), e0195675 (2018)

    Article  Google Scholar 

  15. Ahmed, B.S., Zamli, K.Z., Afzal, W., Bures, M.: Constrained interaction testing: a systematic literature study. IEEE Access. 5, 25706–25730 (2017)

    Article  Google Scholar 

  16. Ghazi, S.A., Ahmed, M.A.: Pair-wise test coverage using genetic algorithms. In: Proceedings of the Congress on Evolutionary Computation, pp. 1420–1424. IEEE, Canberra (2003)

    Google Scholar 

  17. Shiba, T., Tsuchiya, T., Kikuno, T.: Using artificial life techniques to generate test cases for combinatorial testing. In: Proceedings of the 28th Annual International Conference on Computer Software and Applications, pp. 72–77. IEEE, Hong Kong (2004)

    Google Scholar 

  18. Din, F., Zamli, K.Z.: Fuzzy adaptive teaching learning-based optimization strategy for pairwise testing. In: Proceedings of the 7th IEEE International Conference on System Engineering and Technology, pp. 17–22. IEEE, Shah Alam (2017)

    Google Scholar 

  19. Din, F., Zamli, K.Z.: Fuzzy adaptive teaching learning-based optimization strategy for GUI functional test cases generation. In: Proceedings of the 2018 7th international conference on software and computer applications, pp. 92–96. ACM, Kuantan (2018)

    Google Scholar 

  20. Ahmed, B.S., Sahib, M.A., Gambardella, L.M., Afzal, W., Zamli, K.Z.: Optimum design of PIλDμ controller for an automatic voltage regulator system using combinatorial test design. PLoS ONE 11(11), e0166150 (2016)

    Article  Google Scholar 

  21. Zamli, K.Z.: A chaotic teaching learning based optimization algorithm for optimizing emergency flood evacuation routing. Adv. Sci. Lett. 22(10), 2927–2931 (2016)

    Article  Google Scholar 

  22. Rao, R.V., Savsani, V.J., Vakharia, D.P.: Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput. Aided Des. 43(3), 303–313 (2011)

    Article  Google Scholar 

  23. Zamli, K.Z., Din, F., Baharom, S., Ahmed, B.S.: Fuzzy adaptive teaching learning-based optimization strategy for the problem of generating mixed strength t-way test suites. Eng. Appl. Artif. Intell. 59, 35–50 (2017)

    Article  Google Scholar 

  24. Ahmed, B.S., Gambardella, L.M., Afzal, W., Zamli, K.Z.: Handling constraints in combinatorial interaction testing in the presence of multi objective particle swarm and multithreading. Inf. Softw. Technol. 86, 20–36 (2017)

    Article  Google Scholar 

  25. Ahmed, B.S., Zamli, K.Z., Lim, C.P.: Application of particle swarm optimization to uniform and variable strength covering array construction. Appl. Soft Comput. 12(4), 1330–1347 (2012)

    Article  Google Scholar 

  26. Alsariera, Y.A., Zamli, K.Z.: A BAT-inspired strategy for t-way interaction testing. Adv. Sci. Lett. 21(7), 2281–2284 (2015)

    Article  Google Scholar 

  27. Zamli, K.Z., Alkazemi, B.Y., Kendall, G.: A Tabu Search hyper-heuristic strategy for t-way test suite generation. Appl. Soft Comput. 44, 57–74 (2016)

    Article  Google Scholar 

  28. Zamli, K.Z., Din, F., Kendall, G., Ahmed, B.S.: An experimental study of hyper-heuristic selection and acceptance mechanism for combinatorial t-way test suite generation. Inf. Sci. 399, 121–153 (2017)

    Article  Google Scholar 

  29. Cohen, M.B., Gibbons, P.B., Mugridge, W.B., Colbourn, C.J.: Constructing test suites for interaction testing. In: Proceedings of the 25th International Conference on Software Engineering, pp. 38–48. IEEE, Portland (2003)

    Google Scholar 

  30. Alsewari, A.R.A., Zamli, K.Z.: Design and implementation of a harmony-search-based variable-strength t-way testing strategy with constraints support. Inf. Softw. Technol. 54(6), 553–568 (2012)

    Article  Google Scholar 

  31. Nasser, A.B., Zamli, K.Z., Alsewari, A.R.A., Ahmed, B.S.: Hybrid flower pollination algorithm strategies for t-way test suite generation. PLoS ONE 13(5), e0195187 (2018)

    Article  Google Scholar 

Download references

Acknowledgments

The work reported in this paper is funded by Fundamental Research Grant from Ministry of Higher Education Malaysia titled: A Reinforcement Learning Sine Cosine based Strategy for Combinatorial Test Suite Generation (grant no: RDU170103). We thank MOHE for the contribution and support. Fakhrud Din is the recipient of the Malaysian International Scholarship from the Ministry of Higher Education, Malaysia.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kamal Z. Zamli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Din, F., Zamli, K.Z. (2019). Pairwise Test Suite Generation Using Adaptive Teaching Learning-Based Optimization Algorithm with Remedial Operator. In: Saeed, F., Gazem, N., Mohammed, F., Busalim, A. (eds) Recent Trends in Data Science and Soft Computing. IRICT 2018. Advances in Intelligent Systems and Computing, vol 843. Springer, Cham. https://doi.org/10.1007/978-3-319-99007-1_18

Download citation

Publish with us

Policies and ethics