How to Evaluate Competencies in Game-Based Learning Systems Automatically?

  • Pradeepa Thomas
  • Jean-Marc Labat
  • Mathieu Muratet
  • Amel Yessad
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7315)


Serious games are increasingly used in schools, universities or in vocational training. When they are used in the classroom, teachers often have to deal with the lack of tools for monitoring the students during the game and assessing them after the game. So they often tend to add assessment questionnaires to the fun sequence of “learning by playing”, to ensure that students have learned during the session. Our goal is to enable the teacher to do without this type of questionnaires by providing them an automated tool for monitoring and analyzing the actions performed by learners. The system combines an “expert Petri Net” and a domain and game action ontology. Our first experiment conducted on a sample of fifteen students showed that the diagnostic tool gives relatively close results to those of an online assessment questionnaire proposed by the teacher.


Serious games Game-based learning Assessment Petri Nets User tracking 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Johnson, W.L., Wu, S.: Assessing Aptitude for Learning with a Serious Game for Foreign Language and Culture. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 520–529. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  2. 2.
    Virvou, M., Katsionis, G., Manos, K.: Combining Software Games with Education: Evaluation of its Educational Effectiveness. Education Technology & Society 8 (2005)Google Scholar
  3. 3.
    Defreitas, S., Oliver, M.: How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Computers & Education 46, 249–264 (2006)CrossRefGoogle Scholar
  4. 4.
    Hollnagel, E.: Barriers and accident prevention. Ashgate Publishing, Ltd. (2004)Google Scholar
  5. 5.
    del Blanco, Á., Torrente, J., Marchiori, E.J., Martínez-Ortiz, I., Moreno-Ger, P., Fernández-Manjón, B.: Easing assessment of game-based learning with e-adventure and LAMS. In: Proceedings of the Second ACM International Workshop on Multimedia Technologies for Distance Leaning, pp. 25–30. ACM, New York (2010)CrossRefGoogle Scholar
  6. 6.
    Shute, V.J., Masduki, I., Donmez, O.: Conceptual Framework for Modeling, Assessing and Supporting Competencies within Game Environments. Science 8, 137–161 (2010)Google Scholar
  7. 7.
    Thomas, J.M., Young, R.M.: Annie: Automated Generation of Adaptive Learner Guidance for Fun Serious Games. IEEE Transactions on Learning Technologies 3, 329–343 (2010)CrossRefGoogle Scholar
  8. 8.
    Hollnagel, E.: Cognitive reliability and error analysis method: CREAM. Elsevier (1998)Google Scholar
  9. 9.
    Thomas, P., Yessad, A., Labat, J.M.: Petri nets and ontologies: tools for the « learning player » assessment in serious games. In: Proceedings of the 11th IEEE International Conference on Advanced Learning Technologies, pp. 415–419. IEEE Computer Society, Athens (2011)CrossRefGoogle Scholar
  10. 10.
    Yessad, A., Thomas, P., Capdevila, B., Labat, J.-M.: Using the Petri Nets for the Learner Assessment in Serious Games. In: Luo, X., Spaniol, M., Wang, L., Li, Q., Nejdl, W., Zhang, W. (eds.) ICWL 2010. LNCS, vol. 6483, pp. 339–348. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  11. 11.
    Natkin, S., Vega, L.: Petri Net Modelling for the Analysis of the Ordering of Actions in Computer Games. In: Présenté à 4th International Conference on Intelligent Games and Simulation, GAME-ON 2003 (2003)Google Scholar
  12. 12.
    Araujo, M., Roque, L.: Modeling Games with Petri Nets. In: Breaking New Ground: Innovation in Games, Play, Practice and Theory, West London, United Kingdom (2009)Google Scholar
  13. 13.
    Brom, C., Šisler, V., Holan, T.: Story Manager in ‘Europe 2045 ’ Uses Petri NetsGoogle Scholar
  14. 14.
    Abou Assali, A., Lenne, D., Debray, B.: Case Retrieval in Ontology-Based CBR Systems. In: Mertsching, B., Hund, M., Aziz, Z. (eds.) KI 2009. LNCS, vol. 5803, pp. 564–571. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  15. 15.
    Conlan, O., Hampson, C., Peirce, N., Kickmeier-Rust, M.D.: Realtime Knowledge Space Skill Assessment for Personalized Digital Educational Games. In: 2009 Ninth IEEE International Conference on Advanced Learning Technologies, pp. 538–542. IEEE Computer Society, Riga (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Pradeepa Thomas
    • 1
  • Jean-Marc Labat
    • 1
  • Mathieu Muratet
    • 1
  • Amel Yessad
    • 1
  1. 1.Laboratoire d’Informatique de Paris 6Université Pierre et Marie CurieParisFrance

Personalised recommendations