ONTOCOM Revisited: Towards Accurate Cost Predictions for Ontology Development Projects

  • Elena Simperl
  • Igor O. Popov
  • Tobias Bürger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5554)


Reliable methods to assess the costs and benefits of ontologies are an important instrument to demonstrate the tangible business value of semantic technologies within enterprises, as an argument to encourage their wide-scale adoption. The economic aspects of ontologies have been investigated in previous work of ours. With ONTOCOM we proposed a cost estimation model for ontologies and ontology development projects. This paper revisits this model and presents its latest achievements. We report on a comprehensive calibration of ONTOCOM based on a considerably larger data set of 148 ontology development projects. The calibration used a combination of statistical methods, ranging from preliminary data analysis to regression and Bayes analysis, and resulted a significant improvement of the prediction quality of up to 50%. In addition, the availability of a representative data set allowed us to identify meaningful directions for customizing the generic cost model along particular types of ontologies, and ontology-like structures as those specific to the emerging Web 3.0. Last but not least, we developed a software tool that allows ontology development project managers to easily use and adapt and to systematically calibrate the model, thus facilitating its adoption in real-world projects.


Cost Driver Ontology Development Ontology Engineering Preliminary Data Analysis Effort Multiplier 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Boehm, B.W.: Software Engineering Economics. Prentice-Hall, Englewood Cliffs (1981)zbMATHGoogle Scholar
  2. 2.
    Briand, L.C., Basili, V.R., Thomas, W.M.: A pattern recognition approach for software engineering data analysis. IEEE Transactions on Software Engineering 11(18), 931–942 (1992)CrossRefGoogle Scholar
  3. 3.
    Bürger, T., Simperl, E.: Measuring the benefits of ontologies. In: Proceedings of Ontology Content and Evaluation in Enterprise (OntoContent 2008), In conjunction with OnTheMove Federated Conferences (OTM 2008), Monterrey, Mexico, November 9-14 (2008)Google Scholar
  4. 4.
    Cohen, P.R., Chaudhri, V.K., Pease, A., Schrag, R.: Does prior knowledge facilitate the development of knowledge-based systems? In: AAAI/IAAI, pp. 221–226 (1999)Google Scholar
  5. 5.
    Devnani-Chulani, S.: Bayesian analysis of software cost and quality models. PhD thesis, University of Southern California (1999)Google Scholar
  6. 6.
    Felfernig, A.: Effort estimation for knowledge-based configuration systems. In: Proc. of the 16th Int. Conf. of Software Engineering and Knowledge Engineering, SEKE 2004 (2004)Google Scholar
  7. 7.
    Gomez-Perez, A., Fernandez-Lopez, M., Corcho, O.: Ontological Engineering – with examples form the areas of Knowledge Management, e-Commerce and the Semantic Web. Springer, Heidelberg (2004)Google Scholar
  8. 8.
    IEEE Computer Society. IEEE Standard for Developing Software Life Cycle Processes. IEEE Std 1074-1995 (1996)Google Scholar
  9. 9.
    Kemerer, C.F.: An Empirical Validation of Software Cost Estimation Models. Communications of the ACM 30(5) (1987)Google Scholar
  10. 10.
    Kitchenham, B.: A procedure for analyzing unbalanced datasets. IEEE Transactions on Software Engineering 4(24), 278–301 (1998)CrossRefGoogle Scholar
  11. 11.
    Kitchenham, B., Pfleeger, S.L., Pickard, L., Jones, P., Hoaglin, D.C., Emam, K.E., Rosenberg, J.: Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering 8(28), 721–734 (2002)CrossRefGoogle Scholar
  12. 12.
    Korotkiy, M.: On the effect of ontologies on web application development effort. In: Proc. of the Knowledge Engineering and Software Engineering Workshop (2005)Google Scholar
  13. 13.
    Lin, Q., Mintram, R.: Preliminary data analysis methods in software estimation. Software Quality Journal 13(1), 91–115 (2005)CrossRefGoogle Scholar
  14. 14.
    Maxwell, K.: Applied Statistics for Software Managers. Pearson Education, UpperSaddle River (2002)Google Scholar
  15. 15.
    Menzies, T.: Cost benefits of ontologies. Intelligence 10(3), 26–32 (1999)CrossRefGoogle Scholar
  16. 16.
    Paslaru Bontas, E., Tempich, C.: How Much Does It Cost? Applying ONTOCOM to DILIGENT. Technical Report TR-B-05-20, Free University of Berlin (October 2005)Google Scholar
  17. 17.
    Paslaru Bontas, E., Tempich, C.: Ontology engineering: A reality check. In: 5th Int. Conf. on Ontologies, DataBases, and Applications of Semantics (ODBASE 2006) (2006)Google Scholar
  18. 18.
    Paslaru Bontas Simperl, E., Tempich, C., Mochol, M.: Cost estimation for ontology development: Applying the ontocom model. In: Technologies for Business Information Systems, pp. 327–339 (2007)Google Scholar
  19. 19.
    Paslaru Bontas Simperl, E., Tempich, C., Sure, Y.: Ontocom: A cost estimation model for ontology engineering. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 625–639. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  20. 20.
    Putnam, L.H., Myers, W.: Five Core Metrics: Intelligence behind Successful Software Management. Dorset House Publishing Co., Inc. (2003)Google Scholar
  21. 21.
    Stewart, R.D., Wyskida, R.M., Johannes, J.D.: Cost Estimator’s Reference Manual. Wiley, Chichester (1995)Google Scholar
  22. 22.
    Suárez-Figueroa, M.C., Gomez-Perez, A.: Building ontology networks: How to obtain a particular ontology network life cycle? In: Proceedings of the third International Conference on Semantic Systems (I-Semantics) (2008)Google Scholar
  23. 23.
    Völkel, M., Abecker, A.: Cost-benefit analysis for the design of personal knowledge management systems. In: Proceedings of 10th International Conference on Enterprise Information Systems (ICEIS 2008), pp. 95–105 (2008)Google Scholar
  24. 24.
    Wolff, F., Oberle, D., Lamparter, S., Staab, S.: Economic reflections on managing web service using semantics. In: EMISA, pp. 194–207 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Elena Simperl
    • 1
  • Igor O. Popov
    • 1
  • Tobias Bürger
    • 1
  1. 1.Semantic Technology Institute (STI) InnsbruckUniversity of InnsbruckInnsbruckAustria

Personalised recommendations