Empirical Software Engineering

, Volume 21, Issue 1, pp 212–259

Does the level of detail of UML diagrams affect the maintainability of source code?: a family of experiments

  • Ana M. Fernández-Sáez
  • Marcela Genero
  • Danilo Caivano
  • Michel R. V. Chaudron
Article

DOI: 10.1007/s10664-014-9354-4

Cite this article as:
Fernández-Sáez, A.M., Genero, M., Caivano, D. et al. Empir Software Eng (2016) 21: 212. doi:10.1007/s10664-014-9354-4

Abstract

Although the UML is considered to be the de facto standard notation with which to model software, there is still resistance to model-based development. UML modeling is perceived to be expensive and not necessarily cost-effective. It is therefore important to collect empirical evidence concerning the conditions under which the use of UML makes a practical difference. The focus of this paper is to investigate whether and how the Level of Detail (LoD) of UML diagrams impacts on the performance of maintenance tasks in a model-centric approach. A family of experiments consisting of one controlled experiment and three replications has therefore been carried out with 81 students with different abilities and levels of experience from 3 countries (The Netherlands, Spain, and Italy). The analysis of the results of the experiments indicates that there is no strong statistical evidence as to the influence of different LoDs. The analysis suggests a slight tendency toward better results when using low LoD UML diagrams, especially if used for the modification of the source code, while a high LoD would appear to be helpful in understanding the system. The participants in our study also favored low LoD diagrams because they were perceived as easier to read. Although the participants expressed a preference for low LoD diagrams, no statistically significant conclusions can be drawn from the set of experiments. One important finding attained from this family of experiments was that the participants minimized or avoided the use of UML diagrams, regardless of their LoD. This effect was probably the result of using small software systems from well-known domains as experimental materials.

Keywords

UML diagrams Software maintenance Level of detail Controlled experiment Replication Family of experiments 

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Ana M. Fernández-Sáez
    • 1
    • 5
  • Marcela Genero
    • 1
  • Danilo Caivano
    • 2
    • 3
  • Michel R. V. Chaudron
    • 4
    • 5
  1. 1.ALARCOS Research Group, Department of Technologies and Information SystemsUniversity of Castilla-La ManchaCiudad RealSpain
  2. 2.Department of InformaticsUniversity of BariBariItaly
  3. 3.SER&Practices s.r.lSpin Off Company of the University of BariBariItaly
  4. 4.Joint Computer Science and Engineering Department of ChalmersUniversity of Technology and University of GothenburgGö̈teborgSweden
  5. 5.Leiden Institute of Advanced Computer SciencesLeiden UniversityLeidenThe Netherlands