Automatic Checklist Generation for the Assessment of UML Models

  • Tom Gelhausen
  • Mathias Landhäußer
  • Sven J. Körner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5421)


Assessing numerous models from students in written exams or homework is an exhausting task. We present an approach for a fair and transparent assessment of the completeness of models according to a natural language domain description. The assessment is based on checklists generated by the tool Sumo χ. Sumo χ directly works on an annotated version of the original exam text, so no ‘gold standard’ is needed.


Modeling Task Software Metrics Linguistic Structure Domain Description Homework Study 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gelhausen, T., Tichy, W.F.: Thematic Role based Generation of UML Models from Real World Requirements. In: First IEEE International Conference on Semantic Computing (ICSC 2007), pp. 282–289 (September 2007)Google Scholar
  2. 2.
    Abbott, R.J.: Program Design by Informal English Descriptions. Communnications of the ACM 26(11), 882–894 (1983)CrossRefzbMATHGoogle Scholar
  3. 3.
    Moreno, A.M.: Object Oriented Analysis from Textual Specification. In: Ninth International Conference on Software Engineering and Knowledge Engineering, Madrid, Spain (June 1997)Google Scholar
  4. 4.
    Landhäußer, M.: Sumo χSAL E-based UML MOdel eXamination (August 2008),
  5. 5.
    Landhäußer, M.: Automatische Erzeugung von Prüflisten zur spezifikationsbezogenen Beurteilung der Vollständigkeit von UML-Modellen. Studienarbeit, Institute for Program Structures and Data Organization (IPD), University of Karlsruhe (July 2008)Google Scholar
  6. 6.
    Parr, T.: ANTLR,
  7. 7.
    Geiß, R., Batz, G.V., Grund, D., Hack, S., Szalkowski, A.: GrGen: A fast SPO-based graph rewriting tool. In: Corradini, A., Ehrig, H., Montanari, U., Ribeiro, L., Rozenberg, G. (eds.) ICGT 2006. LNCS, vol. 4178, pp. 383–397. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Howell, D.C.: Fundamental Statistics for the Behavioral Sciences, 4th edn. Brooks/Cole Publishing Company (1999)Google Scholar
  9. 9.
    Rupp, C.: Requirements and Psychology. IEEE Software 19(3), 16–18 (2002)CrossRefGoogle Scholar
  10. 10.
    Lange, C.F.J., DuBois, B., Chaudron, M.R.V., Demeyer, S.: An Experimental Investigation of UML Modeling Conventions. In: Nierstrasz, O., Whittle, J., Harel, D., Reggio, G. (eds.) MoDELS 2006. LNCS, vol. 4199, pp. 27–41. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Lange, C.F.J., Chaudron, M.R.V.: Managing Model Quality in UML-Based Software Development. In: Chaudron, M.R.V. (ed.) Proc. 13th IEEE International Workshop on Software Technology and Engineering Practice, pp. 7–16 (2005)Google Scholar
  12. 12.
    Lange, C.F.J., Chaudron, M.R.V.: Effects of Defects in UML models: An Experimental Investigation. In: ICSE 2006: Proceeding of the 28th international conference on Software engineering, pp. 401–411. ACM, New York (2006)Google Scholar
  13. 13.
    Lange, C.F.J., Chaudron, M.R.V.: An Empirical Assessment of Completedness in UML Designs. In: EASE 2004: Proceedings of the 8th Internation Conference on Empirical Assessment in Software Engineering, vol. 920, pp. 111–119 (May 2004)Google Scholar
  14. 14.
    Mohagheghi, P., Aagedal, J.: Evaluating Quality in Model-Driven Engineering. In: MISE 2007: Proceedings of the International Workshop on Modeling in Software Engineering, p. 6. IEEE Computer Society, Washington (2007)Google Scholar
  15. 15.
    Lange, C.F.J., Chaudron, M.R.V., Muskens, J.: In Practice: UML Software Architecture and Design Description. IEEE Software 23(2), 40–46 (2006)CrossRefGoogle Scholar
  16. 16.
    Briand, L.C., Hove, S.E., Labiche, Y., Arisholm, E.: Guiding the Application of Design Patterns Based on UML Models. In: Proceedings of IEEE International Conference on Software Maintenance (ICSM), Philadelphia, USA, pp. 234–243 (2006)Google Scholar
  17. 17.
    Kim, H., Boldyreff, C.: Developing Software Metrics Applicable to UML Models. In: Proceedings of QAOOSE 2002 (2002)Google Scholar
  18. 18.
    McQuillan, J.A., Power, J.F.: On the Application of Software Metrics to UML Models. In: Kühne, T. (ed.) MoDELS 2006. LNCS, vol. 4364, pp. 217–226. Springer, Heidelberg (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Tom Gelhausen
    • 1
  • Mathias Landhäußer
    • 1
  • Sven J. Körner
    • 1
  1. 1.Institute for Program Structures and Data OrganizationUniversity of KarlsruheKarlsruheGermany

Personalised recommendations