Function point analysis using NESMA: simplifying the sizing without simplifying the size

Abstract

This paper examines the trade-off between the utility of outputs from simplified functional sizing approaches, and the effort required by these sizing approaches, through a pilot study. The goal of this pilot study was to evaluate the quality of sizing output provided by NESMA’s simplified size estimation methods, adapt their general principles to enhance their accuracy and extent of relevance, and empirically validate such an adapted approach using commercial software projects. A dataset of 11 projects was sized using this adapted approach, and these results compared with those of the established Indicative, Estimated and Full NESMA method approaches. The performances of these adaptations were evaluated against the NESMA approaches in three ways: (1) effort to perform; (2) the accuracy of the total function counts produced; and (3) the accuracy of the profiles of the function counts for each of the base functional component types. The adapted approach outperformed the Indicative NESMA in terms of sizing accuracy and generally performed as well as the Estimated NESMA across both datasets, and required only ~ 50 % of the effort incurred by the Estimated NESMA. This adapted approach, applied to varying levels of information presented in commercial requirements documentation, overcame some of the limitations of simplified functional sizing methods by providing more than simply the simplified ‘indication’ of overall functional size. The provision and refinement of the more detailed function profile enable a greater degree of validation and utility for the size estimate.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. Abran, A., Gil, B., & Lefebvre, E. (2004). Estimation models based on functional profiles. In International workshop on software measurementIWSM/MetriKon (pp. 195–211). Kronisburg, Germany: Shaker Verlag.

  2. Albrecht, A. J. (1979, October 14–17). Measuring application development productivity. In Proceedings of the Joint SHARE, GUIDE, and IBM application development symposium (pp. 83–92). Monterey, California: IBM Corporation.

  3. Bock, D. B., & Klepper, R. (1992). FP-S: A simplified function point counting method. Journal of Systems and Software, 18, 245–254.

    Article  Google Scholar 

  4. Boehm, B. (1981). Software engineering economics. Englewood Cliffs, NJ: Prentice-Hall.

    MATH  Google Scholar 

  5. Boehm, B., Abts, C., Brown, W., Chulani, S., Clark, B. K., Horowitz, E., et al. (2000). Software cost estimation with Cocomo II. Reading, MA: Addison-Wesley.

    Google Scholar 

  6. Buglione, L., & Gencel, C. (2008). Impact of base functional component types on software functional size based effort estimation. In A. Jedlitschka & O. Salo (Eds.), PROFES 2008, Lecture Notes in Computer Science (LCNS) (Vol. 5089, pp. 75–89). Heidelberg: Springer.

    Google Scholar 

  7. Candido, E. J. D., & Sanches, R. (2004). Estimating the size of web applications by using a simplified function point method. In Webmedia & La-Web 2004, Proceedings (Vol. 1, pp. 98–105).

  8. Desharnais, J. M., & Abran, A. (2003, September 23–25). Approximation techniques for measuring function points. In Proceedings of the 13th international workshop on software measurement (IWSM 2003). Montréal (Canada).

  9. Forselius, L. (2006). Faster and more accurate functional size measurement by KISS—Keeping it simple. Cambridge, MA: IFPUG FSS.

    Google Scholar 

  10. Gencel, C., & Demirors, O. (2008). Functional size measurement revisited. ACM Transactions on Software Engineering and Methodology, 17(3), 1–36.

    Article  Google Scholar 

  11. Horgan, G., Khaddaj, S., & Forte, P. (1998). Construction of an FPA-type metric for early lifecycle estimation. Information and Software Technology, 40(8), 409–415.

    Article  Google Scholar 

  12. ISBSG. (2009). ISBSG estimating, benchmarking and research suite 11. International Software Benchmarking Standards Group (ISBSG). http://www.isbsg.org.

  13. ISO/IEC 14143–1:2007. (2007). Information technology—Software measurement—Functional size measurement—Part 1: Definition of concepts. Geneva: International Organization for Standardization.

    Google Scholar 

  14. ISO/IEC 19761:2011. (2011). Software engineering—COSMIC: A functional size measurement method. Geneva: International Organization for Standardization.

    Google Scholar 

  15. ISO/IEC IS 20926:2009. (2009). Software and systems engineering—Software Measurement: IFPUG Functional Size Measurement Method. Geneva: International Organization for Standardization.

    Google Scholar 

  16. ISO/IEC IS 20968:2002. (2002). Software engineering—MK II function point analysis—Counting practices manual. Geneva: International Organization for Standardization.

    Google Scholar 

  17. ISO/IEC IS 24570:2005. (2005). Software engineering—NESMA functional size measurement method version 2.1: Definitions and counting guidelines for the application of Function Point Analysis. Geneva: International Organization for Standardization.

    Google Scholar 

  18. ISO/IEC IS 29881:2010. (2010). Information technology—Systems and software engineering—FISMA 1.1 functional size measurement method. Geneva: International Organization for Standardization.

    Google Scholar 

  19. Jorgensen, M. (2007). Forecasting of software development work effort: Evidence on expert judgement and formal models. International Journal of Forecasting, 23(3), 449–462.

    Article  Google Scholar 

  20. Jorgensen, M., & Shepperd, M. (2007). A systematic review of software development cost estimation studies. IEEE Transactions on Software Engineering, 33(1), 33–53.

    Article  Google Scholar 

  21. Kemerer, C. F. (1993). Reliability of function points measurement—A field experiment. Communications of the ACM, 36(2), 85–97.

    Article  Google Scholar 

  22. Kitchenham, B., & Kansala, K. (1993). Interitem correlations among function points. In Proceedings: 15th international conference on software engineering (pp. 477–480).

  23. Kitchenham, B., Mendes, E., & Travassos, G. H. (2007). Cross versus within-company cost estimation studies: A systematic review. IEEE Transactions on Software Engineering, 33(5), 316–329.

    Article  Google Scholar 

  24. Lokan, C. J. (1999). Empirical study of the correlations between function point elements. In Proceedings of the 1999 6th international software metrics symposium, November 4, 1999–November 6, 1999 (pp. 200–206). Boca Raton, FL, USA: IEEE.

  25. Lokan, C. J. (2000). An empirical analysis of function point adjustment factors. Information and Software Technology, 42(9), 649–659.

    Article  Google Scholar 

  26. MacDonell, S. G., & Shepperd, M. J. (2007). Comparing local and global software estimation models—Reflections on a systematic review. In Proceedings of the 1st international symposium on empirical software engineering and measurement (pp. 404–409). Madrid, Spain: IEEE Computer Society Press.

  27. Meli, R. (1997). Early and extended function point: A new method for function points estimation. In IFPUG-fall conference, September 15–19. ScottsDale, Arizona, USA.

  28. Meli, R., & Santillo, L. (1999). Function point estimation methods: A comparative overview. In FESMA’99 conference proceedings, Amsterdam, 4–8 October.

  29. Molokken-Ostvold, K., Jorgensen, M., Tanilkan, S. S., Gallis, H., Lien, A. C., & Hove, S. E. (2004). A survey on software estimation in the Norwegian industry. In 10th international symposium on software metrics, Proceedings (pp. 208–219). 14–16 September.

  30. NESMA. (2004). Definitions and counting guidelines for the application of function point analysis. NESMA functional size measurement method compliant to ISO/IEC 24570 version 2.1. Published by the Netherlands Software Metrics Association, November 2004. ISBN: 978-90-76258-19-5.

  31. Popovic, J., & Bojic, D. (2012). A comparative evaluation of effort estimation methods in the software life cycle. Computer Science and Information Systems, 9(1), 455–484.

    Article  Google Scholar 

  32. Santillo, L., Conte, M., & Meli, R. (2005). Early & quick function point: Sizing more with less. In Proceedings of the 11th IEEE international software metrics symposium (p. 41). September 19–22, 2005.

  33. Tichenor, C. (2008). How to develop an ILF model to reduce the time and costs required for function point sizing. IFPUG MetricViews Winter 2008. Available at:http://www.ifpug.org/members/newsletter/2008MetricViews/MV_Winter_2008.pdf. Accessed January 10, 2011.

  34. van Heeringen, H. S., van Gorp, E. W. M., & Prins, T. G. (2009). Functional size measurementAccuracy versus costsIs it really worth it? Available at:http://www.slideshare.net/haroldveendam/smef-2009-fsm-accuracy-vs-cost. Accessed December 10, 2012.

  35. Wang, X., Li, J., & Yu, F. (2008). Simplified function point analysis method aiming at small-to-medium-sized software. Jisuanji Gongcheng/Computer Engineering, 34(9), 103–105.

    Google Scholar 

  36. Wilkie, F. G., McChesney, I. R., Morrow, P., Tuxworth, C., & Lester, N. G. (2011). The value of software sizing. Information and Software Technology, 53, 1236–1249.

    Article  Google Scholar 

  37. Wydenbach, G., & Paynter, J. (1995). Software project estimation: A survey of practices in New Zealand. New Zealand Journal of Computing, 6(1B), 317–327.

    Google Scholar 

  38. Yang, D., Wang, Q., Li, M. S., Yang, Y., Ye, K., & Du, J. (2008). A survey on software cost estimation in the Chinese software industry. In Esem’08: Proceedings of the 2008 ACM-IEEE international symposium on empirical software engineering and measurement (pp. 253–262). ACM Press.

  39. Zivkovic, A., Hericko, M., Brumen, B., Beloglavec, S., & Rozman, I. (2005). The impact of details in the class diagram on software size estimation. Informatica, 16(2), 295–312.

    MATH  Google Scholar 

Download references

Acknowledgments

The research team gratefully acknowledges the access to staff and documentation, and participation of Equiniti-ICS in this project. In particular, the team expresses thanks to Charlie Tuxworth, Technical Director at Equiniti-ICS, for his commitment to this work. The authors gratefully acknowledge the feedback from reviewers, which provided a valuable contribution to the completion and presentation of our research study. The research team also gratefully acknowledges financial support from the Department for Employment and Learning.

Author information

Affiliations

Authors

Corresponding author

Correspondence to P. Morrow.

Appendix

Appendix

See Table 10.

Table 10 Sizing data developed from each sizing method

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Morrow, P., Wilkie, F.G. & McChesney, I.R. Function point analysis using NESMA: simplifying the sizing without simplifying the size. Software Qual J 22, 611–660 (2014). https://doi.org/10.1007/s11219-013-9215-1

Download citation

Keywords

  • Software size estimation
  • NESMA
  • Function point analysis
  • Simplified estimation
  • Commercial projects