From Heterogeneous Multisource Traces to Perceptual-Gestural Sequences: the PeTra Treatment Approach

  • Ben-Manson ToussaintEmail author
  • Vanda Luengo
  • Francis Jambon
  • Jérôme Tonetti
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9112)


This paper presents PeTra, a framework proposed for representing and treating multi-source heterogeneous traces from simulated learning environments. We tested our proposition on traces from TELEOS, a simulation-based ITS dedicated to percutaneous orthopedic surgery. This ITS captures learners interactions from three different and independent sources. The conducted experiment demonstrated that the sequences generated by PeTra fostered efficiently: 1) the learning analytics task of evaluating the influence of visual perceptions on learners’ errors; 2) the extraction of interesting association rules potentially reusable for tutoring services production. However, its genericity has not been tested and it will need to be evaluated at a larger scale.


Intelligent Tutoring Systems Knowledge modeling Perceptual-gestural knowledge Educational data mining Heterogeneous traces 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ceaux, E., Vadcard, L., Dubois, M., Luengo, V.: Designing a learning environment in percutaneous surgery: models of knowledge, gesture and learning situations. Paper Presented at the EARLI Symposium Simulation-Based Learning: Analyzing and Fostering Complex Skills in the Context of Medical Education, Amsterdam (2009)Google Scholar
  2. 2.
    Conati, C., Merten, C.: Eye-tracking for user modeling in exploratory learning environments: An empirical evaluation. Knowl.-Based Syst. 20(6), 557–574 (2007)CrossRefGoogle Scholar
  3. 3.
    D’Mello, S., Olney, A., Williams, C., Hays, P.: Gaze tutor: A gaze-reactive intelligent tutoring system. Int. J. Hum.-Comput. Stud. 70(15), 377–398 (2012)CrossRefGoogle Scholar
  4. 4.
    Fournier-Viger, P., Nkambou, R., Mayers, A., Nguifo, E.M., Faghihi, U.: An hybrid expert model to support tutoring services in robotic arm manipulations. In: Batyrshin, I., Sidorov, G. (eds.) MICAI 2011, Part I. LNCS(LNAI), vol. 7094, pp. 478–489. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  5. 5.
    Fournier-Viger, P., Faghihi, U., Nkambou, R., Nguifo, E.M.: CMRules: Mining sequential rules common to several sequences. Journal Know.-Based Syst. 25(1), 63–76 (2012)CrossRefGoogle Scholar
  6. 6.
    Jambon, F., Luengo, V.: Analyse oculométrique avec zones d’intérêt dynamiques : application aux environnements d’apprentissage sur simulateur. In: Actes de la Conférence Ergo’IHM sur les Nouvelles Interactions, Créativité et Usages, Biarritz France (2012) Google Scholar
  7. 7.
    Lach, P.: Intelligent Tutoring Systems Measuring Student’s Effort During Assessment. In: Za\”ıane, O.R., Zilles, S. (eds.) Canadian AI 2013. LNCS, vol. 7884, pp. 346–351. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  8. 8.
    Luengo, V., Larcher, A., Tonetti, J.: Design and implementation of a visual and haptic simulator in a platform for a TEL system in percutaneous orthopedic surgery. In: Medecine Meets Virtual Reality 18. (eds.) Westwood J.D., Vestwood, S.W., pp. 324–328 (2011)Google Scholar
  9. 9.
    Mathews, M., Mitrovic, A., Lin, B., Holland, J., Churcher, N.: Do your eyes give it away? using eye tracking data to understand students’ attitudes towards open student model representations. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 422–427. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  10. 10.
    Mulgund, S.S., Asdigha, M., Zacharias, G.L., Ma, C., Krishnakumar, K., Dohme, J.A., Al, R.: Intelligent tutoring system for simulator-based helicopter flight training. In: Flight Simulation Technologies Conference. American Institute of Aeronautics and Astronautics, Baltimore (1995)Google Scholar
  11. 11.
    Remolina, E., Ramachandran, S., Fu, D., Stottler, R., Howse, W.R.: Intelligent simulation-based tutor for flight training. In: Interservice/Industry Training, Simulation, and Education Conference, pp. 1-13 (2004) Google Scholar
  12. 12.
    Ríos, H.V., Solís, A.L., Aguirre, E., Guerrero, L., Peña, J., Santamaría, A.: Facial expression recognition and modeling for virtual intelligent tutoring systems. In: Cairó, O., Sucar, L.E., Cantu, F.J. (eds.) MICAI 2000. LNCS(LNAI), vol. 1793, pp. 115–126. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  13. 13.
    Steichen, B., Carenini, G., Conati, C.: User-adaptive information visualization: using eye gaze data to infer visualization tasks and user cognitive abilities. In: Proceedings of the 2013 Int. Conf. on Intelligent User Interfaces, pp. 317-328. ACM, New York (2013)Google Scholar
  14. 14.
    Toussaint, B.-M., Luengo, V.: Mining surgery phase-related sequential rules from vertebroplasty simulations traces. In: Holmes, J.H., Bellazzi, R., Sacchi, L., Peek, N. (eds.) AIME 2015. LNCS, vol. 9105, pp. 32–41. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  15. 15.
    Weevers, I., Kuipers, J., Brugman, A.O., Zwiers, J., van Dijk, E.M.A.G., Nijholt, A.: The virtual driving instructor creating awareness in a multi-agent system. In: Xiang, Y., Chaib-Draa, B. (eds.) AI 2003. LNCS, vol. 2671, pp. 596–602. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  16. 16.
    de Winter, J.C.F., de Groot, S., Dankelman, J., Wieringa, P.A., van Paassen, M.M., Mulder, M.: Advancing simulation-based driver training: lessons learned and future perspectives. In: Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 459-464. ACM, New York (2008)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Ben-Manson Toussaint
    • 1
    • 2
    Email author
  • Vanda Luengo
    • 1
  • Francis Jambon
    • 1
  • Jérôme Tonetti
    • 3
  1. 1.Université Grenoble AlpesSt-Martin D’HèresFrance
  2. 2.Ecole Supérieure D’Infotronique D’HaïtiPort-Au-PrinceHaïti
  3. 3.Département Orthopédie-TraumatologieCHU de GrenobleLa TroncheFrance

Personalised recommendations