Accuracy Comparison of Empirical Studies on Software Product Maintainability Prediction

  • Sara Elmidaoui
  • Laila Cheikhi
  • Ali Idri
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 746)


Software maintainability is a very broad activity which ensures that the software product fulfills its changing requirements and enhancement capabilities once on the client side. Predicting software product maintainability contributes to the reduction of software product maintenance costs. In this perspective, many software product maintainability prediction (SPMP) techniques have been proposed in the literature. Some studies have empirically validated their proposed techniques while others have compared the accuracy of the SPMP techniques. This paper reviews a set of 29 studies, which are identified from eight digital libraries and collected from 2000 to 2017. The present paper is targeted to present the various SPMP techniques used and reveals all about the experimental design of these studies.


Software product maintainability Prediction techniques Accuracy criteria 


  1. 1.
    ISO. Systems and Software engineering — Systems and Software Quality Requirements and Evaluation — System and Software Quality Models. ISO/IEC 25010, 34 p. International Organization for Standardization, Geneva, Switzerland (2010)Google Scholar
  2. 2.
    Dhankhar, P., Mittal, H.K., Mittal, A., et al.: Maintainability prediction for object oriented software. Int. J. Adv. Eng. Sci. 1(1), 8–11 (2011)Google Scholar
  3. 3.
    Kiewkanya, M., Jindasawat, N., Muenchaisri, P.: A methodology for constructing maintainability model of object-oriented design. In: Proceedings of the Fourth International Conference on Quality Software, QSIC 2004, pp. 206–213. IEEE (2004)Google Scholar
  4. 4.
    Riaz, M., Mendes, E., Tempero, E.: A systematic review of software maintainability prediction and metrics. In: Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement, pp. 367–377. IEEE Computer Society (2009)Google Scholar
  5. 5.
    Riaz, M.: Maintainability prediction of relational database-driven applications: a systematic review. In: 16th International Conference on Evaluation Assessment in Software Engineering (EASE), pp. 263–272 (2012)Google Scholar
  6. 6.
    Elmidaoui, S., Cheikhi, L., Idri, A.: A survey of empirical studies in software product maintainability prediction models. In: 11th International Conference on Intelligent Systems: Theories and Applications (SITA), pp. 1–6. IEEE (2016)Google Scholar
  7. 7.
    Elmidaoui, S., Cheikhi, L., Idri, A.: Software product maintainability prediction: a survey of secondary studies. In: 4th International Conference on Control, Decision and Information Technologies (CoDIT) (2017)Google Scholar
  8. 8.
    Thwin, M.M.T., Quah, T.S.: Application of neural networks for estimating software maintainability using object-oriented metrics. In: SEKE, pp. 69–73 (2003)Google Scholar
  9. 9.
    Van Koten, C., Gray, A.R.: An application of Bayesian network for predicting object-oriented software maintainability. Inf. Softw. Technol. 48(1), 59–67 (2005)CrossRefGoogle Scholar
  10. 10.
    Zhou, Y., Leung, H.: Predicting object-oriented software maintainability using multivariate adaptive regression splines. J. Syst. Softw. 80(8), 1349–1361 (2006)CrossRefGoogle Scholar
  11. 11.
    Jin, X., Liu, Y., Ren, J., Xu, A., Bie, R.: Locality preserving projection on source code metrics for improved software maintainability. In: Proceedings of AI 2006, pp. 877–886 (2006)Google Scholar
  12. 12.
    Tian, Y., Chen, C., Zhang, C.: AODE for source code metrics for improved software maintainability. In: Fourth International Conference on Semantics, Knowledge and Grid, SKG 2008, pp. 330–335. IEEE (2008)Google Scholar
  13. 13.
    Li-Jin, W., Xin-Xin, H., Zheng-Yuan, N., Wen-Hua, K.: Predicting object-oriented software maintainability using projection pursuit regression. In: 2009 1st International Conference on Information Science and Engineering (ICISE), pp. 3827–3830 (2009)Google Scholar
  14. 14.
    Elish, M.O., Elish, K.O.: Application of TreeNet in predicting object-oriented software maintainability: a comparative study, pp. 69–78 (2009)Google Scholar
  15. 15.
    Kaur, A., Kaur, K., Malhotra, R.: Soft computing approaches for prediction of software maintenance effort. Int. J. Comput. Appl. 1(16), 69–75 (2010)Google Scholar
  16. 16.
    Olatunji, S.O., Rasheed, Z., Sattar, K.A., Al-Mana, A.M., Alshayeb, M., El-Sebakhy, E.A.: Extreme learning machine as maintainability prediction model for object oriented software systems. J. Comput. 2(8), 42–56 (2010)Google Scholar
  17. 17.
    Dubey, S.K., Rana, A., Dash, Y.: Maintainability prediction of object-oriented software system by multilayer perceptron model. SIGSOFT 37(5), 1–4 (2012)CrossRefGoogle Scholar
  18. 18.
    Malhotra, R., Chug, A.: Software maintainability prediction using machine learning algorithms. Int. J. (SEIJ) 2(2), 19–36 (2012)Google Scholar
  19. 19.
    Dash, Y., Dubey, S.L., Rana, A.: Maintainability prediction of object oriented software system by using artificial neural network approach. Int. J. Soft Comput. Eng. (IJSCE) 2(2), 420–423 (2012)Google Scholar
  20. 20.
    Hegedus, P., Ladanyi, G., Siket, I., et al.: Towards building method level maintainability models based on expert evaluations. In: Computer Applications for Software Engineering, Disaster Recovery, and Business Continuity, pp. 146–154. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  21. 21.
    Aljamaan, H., Elish, M.O., Ahmad, I.: An ensemble of computational intelligence models for software maintenance effort prediction. In: International Work-Conference on Artificial Neural Networks, pp. 592–603. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  22. 22.
    Ye, F., Zhu, X., Wang, Y.: A new software maintainability evaluation model based on multiple classifiers combination. In: International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering (QR2MSE), pp. 1588–1591 (2013)Google Scholar
  23. 23.
    Ahmed, M.A., Al-Jamimi, H.A.: Machine learning approaches for predicting software maintainability: a fuzzy-based transparent model. IET Softw. 7(6), 317–326 (2013)CrossRefGoogle Scholar
  24. 24.
    Olatunji, S.O., Ajasin, A.: Sensitivity-based linear learning method and extreme learning machines compared for software maintainability prediction of object-oriented software systems. ICTACT J. Soft Comput. 3, 514–523 (2013)CrossRefGoogle Scholar
  25. 25.
    Kaur, A., Kaur, K.: Statistical comparison of modeling methods for software maintainability prediction. Int. J. Softw. Eng. Knowl. Eng. 23, 743–774 (2013)CrossRefGoogle Scholar
  26. 26.
    Mehra, A., Dubey, S.K.: Maintainability evaluation of object-oriented software system using clustering techniques. IJCT 5(2), 136–143 (2013)CrossRefGoogle Scholar
  27. 27.
    Malhotra, R., Chug, A.: Application of group method of data handling model for software maintainability prediction using object oriented systems. Int. J. Syst. Assur. Eng. Manag. 5(2), 165–173 (2014)CrossRefGoogle Scholar
  28. 28.
    Kaur, A., Kaur, K., Pathak, K.: A proposed new model for maintainability index of open source software. In: 3rd International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions), pp. 1–6 (2014)Google Scholar
  29. 29.
    Kaur, A., Kaur, K., Pathak, K.: Software maintainability prediction by data mining of software code metrics. In: 2014 International Conference on Data Mining and Intelligent Computing (ICDMIC), pp. 1–6. IEEE (2014)Google Scholar
  30. 30.
    Malhotra, R., Chug, A.: A metric suite for predicting software maintainability in data intensive applications. In: Transactions on Engineering Technologies: Special Issue of the World Congress on Engineering and Computer Science, pp. 161–175 (2014)Google Scholar
  31. 31.
    Elish, M.O., Aljamaan, H., Ahmad, I.: Three empirical studies on predicting software maintainability using ensemble methods. Soft Comput. 19(9), 2511–2524 (2015)CrossRefGoogle Scholar
  32. 32.
    Kumar, L., Rath, S.K.: Neuro – genetic approach for predicting maintainability using Chidamber and Kemerer software metrics suite. In: Recent Advances in Information and Communication Technology, pp. 31–40. Springer, Cham (2015)Google Scholar
  33. 33.
    Olatunji, S.O., Selamat, A.: Type-2 fuzzy logic based prediction model of object oriented software maintainability. Communications in Computer and Information Science, vol. 513, pp. 329–342 (2015)Google Scholar
  34. 34.
    Soni, A.K., Lobiyal, D.K., Kumar, L., Naik, D.K., Rath, S.K.: Validating the effectiveness of object-oriented metrics for predicting maintainability. In: 3rd International Conference on Recent Trends in Computing (ICRTC 2015). Procedia Computer Science, vol. 57, pp. 798–806 (2015)Google Scholar
  35. 35.
    Kumar, L., Rath, S.K.: Hybrid functional link artificial neural network approach for predicting maintainability of object-oriented software. J. Syst. Softw. 121, 170–190 (2016)CrossRefGoogle Scholar
  36. 36.
    Kumar, L., Rath, S.K., Sureka, A.: Using source code metrics and multivariate adaptive regression splines to predict maintainability of service oriented software. In: International Symposium on High Assurance Systems Engineering (HASE), Singapore (2017)Google Scholar
  37. 37.
    Idri, A., Amazal, F.A., Abran, A.: Analogy-based software development effort estimation: a systematic mapping and review. Inf. Softw. Technol. 58, 206–230 (2015)CrossRefGoogle Scholar
  38. 38.
    Wen, J., Li, S., Lin, Z., Hu, Y., Huang, C.: Systematic literature review of machine learning based software development effort estimation models. Inf. Softw. Technol. 54, 41–59 (2012)CrossRefGoogle Scholar
  39. 39.
    Malhotra, R.: A systematic review of machine learning techniques for software fault prediction. Appl. Soft Comput. 27, 504–518 (2015)CrossRefGoogle Scholar
  40. 40.
    Li, W., Henry, S.: Object-oriented metrics that predict maintainability. J. Syst. Softw. 23(2), 111–122 (1993)CrossRefGoogle Scholar
  41. 41.
    Conte, S.D., Dunsmore, H.E., Shen, V.Y.: Software Engineering Metrics and Models. Benjamin Cummings Publishing Co., Inc., Redwood City (1986)Google Scholar
  42. 42.
    Gray, A.R., MacDonell, S.G.: A comparison of techniques for developing predictive models of software metrics. Inf. Softw. Technol. 39(6), 425–437 (1997)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Software Project Management Research Team, ENSIASMohammed V UniversityRabatMorocco

Personalised recommendations