Crowd-Powered Design of Virtual Attentive Listeners

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10498)


This demo presents a web-based system that generates attentive listening behaviours in a virtual agent acquired from audio-visual recordings of attitudinal feedback behaviour of crowdworkers.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baltrušaitis, T., Robinson, P., Morency, L.P.: Openface: an open source facial behavior analysis toolkit. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–10. IEEE (2016)Google Scholar
  2. 2.
    Breazeal, C., DePalma, N., Orkin, J., Chernova, S., Jung, M.: Crowdsourcing human-robot interaction: New methods and system evaluation in a public environment. Journal of Human-Robot Interaction 2(1), 82–111 (2013)CrossRefGoogle Scholar
  3. 3.
    Ekman, P., Friesen, W.V.: Facial action coding system (1977)Google Scholar
  4. 4.
    Leite, I., Pereira, A., Funkhouser, A., Li, B., Lehman, J.F.: Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 13–20. ACM (2016)Google Scholar
  5. 5.
    Oertel, C., Jonell, P., Kontogiorgos, D., Mendelson, J., Beskow, J., Gustafson, J.: Crowd-sourced design of artificial attentive listeners. In: Interspeech 2017 (2017). AcceptedGoogle Scholar
  6. 6.
    Oertel, C., Lopes, J., Yu, Y., Mora, K.A.F., Gustafson, J., Black, A.W., Odobez, J.M.: Towards building an attentive artificial listener: on the perception of attentiveness in audio-visual feedback tokens. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 21–28. ACM (2016)Google Scholar
  7. 7.
    Orkin, J., Roy, D.: Automatic learning and generation of social behavior from collective human gameplay. In: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1, pp. 385–392. International Foundation for Autonomous Agents and Multiagent Systems (2009)Google Scholar
  8. 8.
    Mahrt, T.: ProMo: The Prosody-Morphing Library. (2016). Accessed 15, May 2017
  9. 9.
    Yu, Z., Xu, Z., Black, A., Rudnicky, A.: Chatbot evaluation and database expansion via crowdsourcing. In: Proc. of the chatbot workshop of LREC 2016 (2016)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Speech, Music and HearingKTH Royal Institute of TechnologyStockholmSweden

Personalised recommendations