Representing Communicative Functions in SAIBA with a Unified Function Markup Language

  • Angelo Cafaro
  • Hannes Högni Vilhjálmsson
  • Timothy Bickmore
  • Dirk Heylen
  • Catherine Pelachaud
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8637)


The SAIBA framework proposes two interface languages to represent separately an intelligent agent’s communicative functions (or intents) and the multimodal behavior determining how the functions are accomplished with a particular multimodal realization. For the functional level, the Function Markup Language (FML) has been proposed. In this paper we summarize the current status of FML as discussed by the SAIBA community, we underline the major issues that need to be addressed to obtain a unified FML specification, we suggest further issues that we identified and we propose a new unified FML specification that addresses many of these issues.


function markup language communicative function multimodal communication embodied conversational agents 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: Embodiment in conversational interfaces: Rea. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1999, pp. 520–527. ACM (1999)Google Scholar
  2. 2.
    Niewiadomski, R., Bevacqua, E., Mancini, M., Pelachaud, C.: Greta: an interactive expressive eca system. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1399–1400 (2009)Google Scholar
  3. 3.
    Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: Beat: the behavior expression animation toolkit. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2001, pp. 477–486. ACM (2001)Google Scholar
  4. 4.
    Vilhjálmsson, H.H.: Augmenting online conversation through automated discourse tagging. In: Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS 2005) - Track 4, vol. 04, p. 109.1. IEEE Computer Society (2005)Google Scholar
  5. 5.
    Hartholt, A., Traum, D., Marsella, S.C., Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., Gratch, J.: All together now - introducing the virtual human toolkit. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 368–381. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  6. 6.
    van Oijen, J.: A framework to support the influence of culture on nonverbal behavior generation in embodied conversational agents. Master’s thesis, University of Twente (2007)Google Scholar
  7. 7.
    Kopp, S., Krenn, B., Marsella, S.C., Marshall, A.N., Pelachaud, C., Pirker, H., Thórisson, K.R., Vilhjálmsson, H.H.: Towards a common framework for multimodal generation: The behavior markup language. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Heylen, D., Kopp, S., Marsella, S.C., Pelachaud, C., Vilhjálmsson, H.H.: The next step towards a function markup language. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 270–280. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  9. 9.
    Vilhjálmsson, H.H., et al.: The behavior markup language: Recent developments and challenges. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 99–111. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    Samtani, P., Valente, A., Johnson, W.L.: Applying the saiba framework to the tactical language and culture training system. In: Workshop on Functional Representations for Generating Conversational Agent Behavior at AAMAS (2008)Google Scholar
  11. 11.
    Mancini, M., Pelachaud, C.: The fml-apml language. In: Workshop on Functional Representations for Generating Conversational Agents Behavior at AAMAS (2008)Google Scholar
  12. 12.
    Kranstedt, A., Kopp, S., Wachsmuth, I.: Murml: A multimodal utterance representation markup language for conversational agents. In: Proceedings of the AAMAS Workshop on Embodied Conversational Agents Let’s Specify and Evaluate Them! (2002)Google Scholar
  13. 13.
    Thórisson, K.R., Vilhjálmsson, H.H.: Functional description of multimodal acts: A proposal. In: Proceedings of the 2nd Function Markup Language Workshop “Towards a Standard Markup Langauge for Embodied Dialogue Acts” at AAMAS (2009)Google Scholar
  14. 14.
    Bevacqua, E., Prepin, K., de Sevin, E., Niewiadomski, R., Pelachaud, C.: Reactive behaviors in saiba architecture. In: Proceedings of the 2nd Function Markup Language Workshop “Towards a Standard Markup Langauge for Embodied Dialogue Acts” at AAMAS (2009)Google Scholar
  15. 15.
    Vilhjálmsson, H.H.: Representing communicative function and behavior in multimodal communication. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) COST Action 2102. LNCS, vol. 5398, pp. 47–59. Springer, Heidelberg (2009)Google Scholar
  16. 16.
    McCrae, R.R., Costa Jr., P.T.: Personality trait structure as a human universal. American Psychologist 52(5), 509–516 (1997)CrossRefGoogle Scholar
  17. 17.
    Goffman, E.: Forms of Talk. University of Pennsylvania Press, Philadelphia (1981)Google Scholar
  18. 18.
    Argyle, M.: Bodily communication, 2nd edn. Methuen, New York (1988)Google Scholar
  19. 19.
    Kendon, A.: Conducting Interaction: Patterns of Behavior in Focused Encounters (Studies in Interactional Sociolinguistics). Cambridge University Press, New York (1990)Google Scholar
  20. 20.
    Cafaro, A.: First Impressions in Human-Agent Virtual Encounters. PhD thesis, Center for Analysis and Design of Intelligent Agents, Reykjavik University, Iceland (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Angelo Cafaro
    • 1
  • Hannes Högni Vilhjálmsson
    • 2
  • Timothy Bickmore
    • 3
  • Dirk Heylen
    • 4
  • Catherine Pelachaud
    • 1
  1. 1.CNRS-LTCI, Telecom ParisTechFrance
  2. 2.Center for Analysis and Design of Intelligent AgentsReykjavik UniversityIceland
  3. 3.College of Computer and Information ScienceNortheastern UniversityUSA
  4. 4.Human Media InteractionUniversity of TwenteThe Netherlands

Personalised recommendations