Skip to main content

Crowd-Powered Design of Virtual Attentive Listeners

  • Conference paper
  • First Online:
Intelligent Virtual Agents (IVA 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10498))

Included in the following conference series:


This demo presents a web-based system that generates attentive listening behaviours in a virtual agent acquired from audio-visual recordings of attitudinal feedback behaviour of crowdworkers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Baltrušaitis, T., Robinson, P., Morency, L.P.: Openface: an open source facial behavior analysis toolkit. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–10. IEEE (2016)

    Google Scholar 

  2. Breazeal, C., DePalma, N., Orkin, J., Chernova, S., Jung, M.: Crowdsourcing human-robot interaction: New methods and system evaluation in a public environment. Journal of Human-Robot Interaction 2(1), 82–111 (2013)

    Article  Google Scholar 

  3. Ekman, P., Friesen, W.V.: Facial action coding system (1977)

    Google Scholar 

  4. Leite, I., Pereira, A., Funkhouser, A., Li, B., Lehman, J.F.: Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 13–20. ACM (2016)

    Google Scholar 

  5. Oertel, C., Jonell, P., Kontogiorgos, D., Mendelson, J., Beskow, J., Gustafson, J.: Crowd-sourced design of artificial attentive listeners. In: Interspeech 2017 (2017). Accepted

    Google Scholar 

  6. Oertel, C., Lopes, J., Yu, Y., Mora, K.A.F., Gustafson, J., Black, A.W., Odobez, J.M.: Towards building an attentive artificial listener: on the perception of attentiveness in audio-visual feedback tokens. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 21–28. ACM (2016)

    Google Scholar 

  7. Orkin, J., Roy, D.: Automatic learning and generation of social behavior from collective human gameplay. In: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1, pp. 385–392. International Foundation for Autonomous Agents and Multiagent Systems (2009)

    Google Scholar 

  8. Mahrt, T.: ProMo: The Prosody-Morphing Library. (2016). Accessed 15, May 2017

  9. Yu, Z., Xu, Z., Black, A., Rudnicky, A.: Chatbot evaluation and database expansion via crowdsourcing. In: Proc. of the chatbot workshop of LREC 2016 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Patrik Jonell .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Jonell, P., Oertel, C., Kontogiorgos, D., Beskow, J., Gustafson, J. (2017). Crowd-Powered Design of Virtual Attentive Listeners. In: Beskow, J., Peters, C., Castellano, G., O'Sullivan, C., Leite, I., Kopp, S. (eds) Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science(), vol 10498. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67400-1

  • Online ISBN: 978-3-319-67401-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics