Abstract
Software systems nowadays have large configuration spaces. Pairwise test design technique is found useful by testers to sample only required configuration options of these systems for exploring errors owing to their interactions. Being a NP-complete problem, pairwise test suite generation problem has been addressed using several meta-heuristic algorithms including the Fuzzy Adaptive Teaching Learning-based Optimization (ATLBO) algorithm in the literature. ATLBO is a recent enhanced variant of Teaching Learning-based Optimization (TLBO) algorithm that adaptively applies its search operations using a Mamdani-type fuzzy inference system. Presently, ATLBO enters into stagnation or sometimes converges abnormally after some iterations. To address this issue, this paper proposes ATLBO with a remedial operator so as to further improve its searching capabilities. To evaluate the performance of ATLBO with remedial operator, it is used in a strategy called pATLBO_RO for the pairwise test suite generation problem. Experimental results reveal the strong performance of pATLBO_RO against other meta-heuristic and hyper-heuristic based pairwise test suite generation strategies.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Myers, G.J., Sandler, C., Badgett, T.: The Art of Software Testing, 3rd edn. Wiley, Hoboken (2011)
Zamli, K.Z., Alkazemi, B.Y.: Combinatorial Testing. UMP Publisher, Pahang (2015)
Yilmaz, C., Fouch, S., Cohen, M.B., Porter, A., Demiroz, G., Koc, U.: Moving forward with combinatorial interaction testing. Computer 47(2), 37–45 (2014)
Ahmed, B.S., Zamli, K.Z.: A variable-strength interaction test suites generation strategy using particle swarm optimization. J. Syst. Softw. 84(12), 2171–2185 (2011)
Ahmed, B.S., Zamli, K.Z.: The development of a particle swarm based optimization strategy for pairwise testing. J. Artif. Intell. 4(2), 156–165 (2011)
Alsewari, A.R.A., Zamli, K.Z.: A harmony search based pairwise sampling strategy for combinatorial testing. Int. J. Phys. Sci. 7(7), 1062–1072 (2012)
Din, F., Alsewari, A.R.A., Zamli, K.Z.: A parameter free choice function based hyper-heuristic strategy for pairwise test generation. In: Proceedings of the IEEE International Conference on Software Quality, Reliability and Security Companion, pp. 85–91. IEEE, Prague (2017)
Klaib, M., Zamli, K.Z., Isa, N., Younis, M., Abdullah, R.: G2Way a backtracking strategy for pairwise test data generation. In: Proceedings of the 15th Asia-Pacific Software Engineering Conference, pp. 463–470. IEEE, Beijing (2008)
Nasser, A.B., Alsariera, Y.A., AlSewari, A.R.A., Zamli, K.Z.: A Cuckoo Search based pairwise strategy for combinatorial testing problem. J. Theor. Appl. Inf. Technol. 82(1), 154–162 (2015)
Nasser, A.B., Alsewari, A.A., Tairan, N.M., Zamli, K.Z.: Pairwise test data generation based on flower pollination algorithm. Malay. J. Comput. Sci. 30(3), 242–257 (2017)
Othman, R.R., Zamli, K.Z.: ITTDG: integrated t-way test data generation strategy for interaction testing. Sci. Res. Essays 6(17), 3638–3648 (2011)
Younis, M.I., Zamli, K.Z., Isa, N.A.M.: MIPOG-modification of the IPOG strategy for t-way software testing. In: Proceedings of the Distributed Frameworks and Applications, pp. 1–6. IEEE, Beijing (2008)
Younis, M.I., Zamli, K.Z., Isa, N.A.M.: Algebraic strategy to generate pairwise test set for prime number parameters and variables. In: Proceedings of the International Symposium on Information Technology, pp. 1–4. IEEE, Kuala Lumpur (2008)
Zamli, K.Z., Din, F., Ahmed, B.S., Bures, M.: A hybrid q-learning sine-cosine-based strategy for addressing the combinatorial test suite minimization problem. PLoS ONE 13(5), e0195675 (2018)
Ahmed, B.S., Zamli, K.Z., Afzal, W., Bures, M.: Constrained interaction testing: a systematic literature study. IEEE Access. 5, 25706–25730 (2017)
Ghazi, S.A., Ahmed, M.A.: Pair-wise test coverage using genetic algorithms. In: Proceedings of the Congress on Evolutionary Computation, pp. 1420–1424. IEEE, Canberra (2003)
Shiba, T., Tsuchiya, T., Kikuno, T.: Using artificial life techniques to generate test cases for combinatorial testing. In: Proceedings of the 28th Annual International Conference on Computer Software and Applications, pp. 72–77. IEEE, Hong Kong (2004)
Din, F., Zamli, K.Z.: Fuzzy adaptive teaching learning-based optimization strategy for pairwise testing. In: Proceedings of the 7th IEEE International Conference on System Engineering and Technology, pp. 17–22. IEEE, Shah Alam (2017)
Din, F., Zamli, K.Z.: Fuzzy adaptive teaching learning-based optimization strategy for GUI functional test cases generation. In: Proceedings of the 2018 7th international conference on software and computer applications, pp. 92–96. ACM, Kuantan (2018)
Ahmed, B.S., Sahib, M.A., Gambardella, L.M., Afzal, W., Zamli, K.Z.: Optimum design of PIλDμ controller for an automatic voltage regulator system using combinatorial test design. PLoS ONE 11(11), e0166150 (2016)
Zamli, K.Z.: A chaotic teaching learning based optimization algorithm for optimizing emergency flood evacuation routing. Adv. Sci. Lett. 22(10), 2927–2931 (2016)
Rao, R.V., Savsani, V.J., Vakharia, D.P.: Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput. Aided Des. 43(3), 303–313 (2011)
Zamli, K.Z., Din, F., Baharom, S., Ahmed, B.S.: Fuzzy adaptive teaching learning-based optimization strategy for the problem of generating mixed strength t-way test suites. Eng. Appl. Artif. Intell. 59, 35–50 (2017)
Ahmed, B.S., Gambardella, L.M., Afzal, W., Zamli, K.Z.: Handling constraints in combinatorial interaction testing in the presence of multi objective particle swarm and multithreading. Inf. Softw. Technol. 86, 20–36 (2017)
Ahmed, B.S., Zamli, K.Z., Lim, C.P.: Application of particle swarm optimization to uniform and variable strength covering array construction. Appl. Soft Comput. 12(4), 1330–1347 (2012)
Alsariera, Y.A., Zamli, K.Z.: A BAT-inspired strategy for t-way interaction testing. Adv. Sci. Lett. 21(7), 2281–2284 (2015)
Zamli, K.Z., Alkazemi, B.Y., Kendall, G.: A Tabu Search hyper-heuristic strategy for t-way test suite generation. Appl. Soft Comput. 44, 57–74 (2016)
Zamli, K.Z., Din, F., Kendall, G., Ahmed, B.S.: An experimental study of hyper-heuristic selection and acceptance mechanism for combinatorial t-way test suite generation. Inf. Sci. 399, 121–153 (2017)
Cohen, M.B., Gibbons, P.B., Mugridge, W.B., Colbourn, C.J.: Constructing test suites for interaction testing. In: Proceedings of the 25th International Conference on Software Engineering, pp. 38–48. IEEE, Portland (2003)
Alsewari, A.R.A., Zamli, K.Z.: Design and implementation of a harmony-search-based variable-strength t-way testing strategy with constraints support. Inf. Softw. Technol. 54(6), 553–568 (2012)
Nasser, A.B., Zamli, K.Z., Alsewari, A.R.A., Ahmed, B.S.: Hybrid flower pollination algorithm strategies for t-way test suite generation. PLoS ONE 13(5), e0195187 (2018)
Acknowledgments
The work reported in this paper is funded by Fundamental Research Grant from Ministry of Higher Education Malaysia titled: A Reinforcement Learning Sine Cosine based Strategy for Combinatorial Test Suite Generation (grant no: RDU170103). We thank MOHE for the contribution and support. Fakhrud Din is the recipient of the Malaysian International Scholarship from the Ministry of Higher Education, Malaysia.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Din, F., Zamli, K.Z. (2019). Pairwise Test Suite Generation Using Adaptive Teaching Learning-Based Optimization Algorithm with Remedial Operator. In: Saeed, F., Gazem, N., Mohammed, F., Busalim, A. (eds) Recent Trends in Data Science and Soft Computing. IRICT 2018. Advances in Intelligent Systems and Computing, vol 843. Springer, Cham. https://doi.org/10.1007/978-3-319-99007-1_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-99007-1_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99006-4
Online ISBN: 978-3-319-99007-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)