Advertisement

The TARDIS Framework: Intelligent Virtual Agents for Social Coaching in Job Interviews

  • Keith Anderson
  • Elisabeth André
  • T. Baur
  • Sara Bernardini
  • M. Chollet
  • E. Chryssafidou
  • I. Damian
  • C. Ennis
  • A. Egges
  • P. Gebhard
  • H. Jones
  • M. Ochs
  • C. Pelachaud
  • Kaśka Porayska-Pomsta
  • P. Rizzo
  • Nicolas Sabouret
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8253)

Abstract

The TARDIS project aims to build a scenario-based serious-game simulation platform for NEETs and job-inclusion associations that supports social training and coaching in the context of job interviews. This paper presents the general architecture of the TARDIS job interview simulator, and the serious game paradigm that we are developing.

Keywords

Facial Expression Emotional Intelligence Social Signal Facial Expression Recognition Virtual Character 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [APD+09]
    Aylett, R., Paiva, A., Dias, J., Hall, L., Woods, S.: Affective agents for education against bullying. In: Affective Information Processing, pp. 75–90. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. [Arg88]
    Argyle, M.: Bodily Communication. University paperbacks, Methuen (1988)Google Scholar
  3. [BDL+13]
    Baur, T., Damian, I., Lingenfelser, F., Wagner, J., André, E.: Nova: Automated analysis of nonverbal signals in social interactions. In: Human Behavior Understanding (HBU) Workshop at 21st ACM International Conference on Multimedia (2013)CrossRefGoogle Scholar
  4. [BDSHP12]
    Bevacqua, E., De Sevin, E., Hyniewska, S.J., Pelachaud, C.: A listener model: introducing personality traits. Journal on Multimodal User Interfaces 6(1-2), 27–38 (2012)CrossRefGoogle Scholar
  5. [BMNP07]
    Bevacqua, E., Mancini, M., Niewiadomski, R., Pelachaud, C.: An expressive eca showing complex emotions. In: Proceedings of the AISB Annual Convention, Newcastle, UK, pp. 208–216 (2007)Google Scholar
  6. [BP02]
    Bynner, J., Parsons, S.: Social exclusion and the transition from school to work: The case of young people not in education, employment, or training (neet). Journal of Vocational Behavior 60(2), 289–309 (2002)CrossRefGoogle Scholar
  7. [CRKK06]
    Caridakis, G., Raouzaiou, A., Karapouzis, K., Kollias, S.: Synthesizing gesture expressivity based on real sequences. In: Workshop on Multimodal Corpora: from Multimodal Behaviour Theories to Usable Models, LREC Conf., Genoa, Italy (May 2006)Google Scholar
  8. [DBA13]
    Damian, I., Baur, T., André, E.: Investigating social cue-based interaction in digital learning games. In: Proceedings of the 8th International Conference on the Foundations of Digital Games, SASDG (2013)Google Scholar
  9. [DM99]
    DeGroot, T., Motowidlo, S.J.: Why visual and vocal interview cues can affect interviewers’ judgments and predict job performance. Journal of Applied Psychology 84(6), 986–993 (1999)CrossRefGoogle Scholar
  10. [dR13]
    Société Française de Radiotéléphonie. Mon entretien d’embauche game (June 2013)Google Scholar
  11. [EDVDB10]
    Engelen, J., Dekelver, J., Van Den Bosch, W.: Incluso: Social software for the social inclusion of marginalised youth. Social Media for Social Inclusion of Youth at Risk 1(1), 11–20 (2010)Google Scholar
  12. [EE12]
    Ennis, C., Egges, A.: Perception of complex emotional body language of a virtual character. In: Kallmann, M., Bekris, K. (eds.) MIG 2012. LNCS, vol. 7660, pp. 112–121. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  13. [GMK12]
    Gebhard, P., Mehlmann, G., Kippo, M.: Visual scenemaker - a tool for authoring interactive virtual characters. Journal on Multimodal User Interfaces 6(1-2), 3–11 (2012)CrossRefGoogle Scholar
  14. [Gol06]
    Goleman, D.: Social intelligence: The new science of human relationships. Bantam (2006)Google Scholar
  15. [HCM+13]
    Hoque, M.E., Courgeon, M., Martin, J., Mutlu, B., Picard, R.W.: Mach: My automated conversation coach. In: Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2013 (to appear, 2013)Google Scholar
  16. [HH10]
    Hareli, S., Hess, U.: What emotional reactions can tell us about the nature of others: An appraisal perspective on person perception. Cognition & Emotion 24(1), 128–140 (2010)CrossRefGoogle Scholar
  17. [Ins13]
    Serious Games Insitute. ispectrum game (June 2013)Google Scholar
  18. [JS13]
    Jones, H., Sabouret, N.: TARDIS - A simulation platform with an affective virtual recruiter for job interviews. In: IDGEI (Intelligent Digital Games for Empowerment and Inclusion) (2013)Google Scholar
  19. [JYZ12]
    Jiao, Y., Yang, X., Zhang, J.J.: A serious game prototype for post-stroke rehabilitation using kinect. Journal of Game Amusement Society 4(1) (2012)Google Scholar
  20. [KH10]
    Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction. Cengage Learning (2010)Google Scholar
  21. [Les94]
    Leslie, A.M.: ToMM, ToBy, and agency: Core architecture and domain specificity. In: Hirschfeld, L.A., Gelman, S.A. (eds.) Mapping the Mind Domain Specificity in Cognition and Culture, ch. 5, pp. 119–148. Cambridge University Press (1994)Google Scholar
  22. [MC05]
    Manske, M., Conati, C.: Modelling learning in an educational game. In: Proceeding of the 2005 Conference on Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, pp. 411–418 (2005)Google Scholar
  23. [Meh96]
    Mehrabian, A.: Pleasure-arousal-dominance: A general framework for describing and measuring individual Differences in Temperament. Current Psychology 14(4), 261 (1996)MathSciNetCrossRefGoogle Scholar
  24. [MGR03]
    Marsella, S., Gratch, J., Rickel, J.: Expressive behaviors for virtual worlds. In: Lifelike Characters Tools Affective Functions and Applications, pp. 317–360 (2003)Google Scholar
  25. [MSS04]
    Mitchell, A., Savill-Smith, C.: The use of computer and video games for learning: A review of the literature (2004)Google Scholar
  26. [NHP11]
    Niewiadomski, R., Hyniewska, S.J., Pelachaud, C.: Constraint-based model for synthesis of multimodal sequential expressions of emotions. IEEE Transactions on Affective Computing 2(3), 134–146 (2011)CrossRefGoogle Scholar
  27. [OCC88]
    Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press (July 1988)Google Scholar
  28. [Orv10]
    Orvalho, V.: Lifeisgame: Learning of facial emotions using serious games. In: Proc. Body Representation in Physical and Virtual Reality with Application to Rehabilitation (2010)Google Scholar
  29. [PDS+04]
    Paiva, A., Dias, J., Sobral, D., Aylett, R., Sobreperez, P., Woods, S., Zoll, C., Hall, L.: Caring for agents and agents that care: Building empathic relations with synthetic agents. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 194–201. IEEE Computer Society, Washington, DC (2004)Google Scholar
  30. [Pic97]
    Picard, R.W.: Affective Computing. Emotion TR 221(321), 97–97 (1997)Google Scholar
  31. [PSS09]
    Pareto, L., Schwartz, D.L., Svensson, L.: Learning by guiding a teachable agent to play an educational game. In: Education Building Learning, pp. 1–3 (2009)Google Scholar
  32. [SMBC+13]
    Schuller, B., Marchi, E., Baron-Cohen, S., O’Reilly, H., Robinson, P., Davies, I., Golan, O., Friedenson, S., Tal, S., Newman, S., Meir, N., Shillo, R., Camurri, A., Piana, S., Bölte, S., Lundqvist, D., Berggren, S., Baranger, A., Sullings, N.: Asc-inclusion: Interactive emotion games for social inclusion of children with autism spectrum conditions. In: Proc. 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion, IDGEI 2013 (2013)Google Scholar
  33. [SS12]
    Siegel, S., Smeddinck, J.: Adaptive difficulty with dynamic range of motion adjustments in exergames for parkinson’s disease patients. In: Herrlich, M., Malaka, R., Masuch, M. (eds.) ICEC 2012. LNCS, vol. 7522, pp. 429–432. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  34. [TC08]
    Tartaro, A., Cassell, J.: Playing with virtual peers: bootstrapping contingent discourse in children with autism. In: Proceedings of the 8th International Conference on International Conference for the Learning Sciences, vol. 2, pp. 382–389. International Society of the Learning Sciences (2008)Google Scholar
  35. [WLB+13]
    Wagner, J., Lingenfelser, F., Baur, T., Damian, I., Kistler, F., André, E.: The social signal interpretation (ssi) framework - multimodal signal processing and recognition in real-time. In: Proceedings of ACM MULTIMEDIA 2013, Barcelona (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Keith Anderson
    • 1
  • Elisabeth André
    • 1
  • T. Baur
    • 1
  • Sara Bernardini
    • 1
  • M. Chollet
    • 1
  • E. Chryssafidou
    • 1
  • I. Damian
    • 1
  • C. Ennis
    • 1
  • A. Egges
    • 1
  • P. Gebhard
    • 1
  • H. Jones
    • 1
  • M. Ochs
    • 1
  • C. Pelachaud
    • 1
  • Kaśka Porayska-Pomsta
    • 1
  • P. Rizzo
    • 1
  • Nicolas Sabouret
    • 1
  1. 1.The TARDIS consortiumUK

Personalised recommendations