Eliciting Positive Emotional Impact in Dialogue Response Selection

  • Nurul LubisEmail author
  • Sakriani Sakti
  • Koichiro Yoshino
  • Satoshi Nakamura
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 510)


Introduction of emotion into human-computer interaction (HCI) have allowed various system’s abilities that can benefit the user. Among many is emotion elicitation, which is highly potential in providing emotional support. To date, works on emotion elicitation have only focused on the intention of elicitation itself, e.g. through emotion targets or personalities. In this paper, we aim to extend the existing studies by utilizing examples of human appraisal in spoken dialogue to elicit a positive emotional impact in an interaction. We augment the widely used example-based approach with emotional constraints: (1) emotion similarity between user query and examples, and (2) potential emotional impact of the candidate responses. Text-based human subjective evaluation with crowdsourcing shows that the proposed dialogue system elicits an overall more positive emotional impact, and yields higher coherence as well as emotional connection.


Affective computing Dialogue system Emotion elicitation 



This research and development work was supported by the MIC/SCOPE #152307004.


  1. 1.
    Ball G, Breese J (2000) Emotion and personality in a conversational agent. Embodied conversational agents, pp. 189–219Google Scholar
  2. 2.
    Cohen AN, Hammen C, Henry RM, Daley SE (2004) Effects of stress and social support on recurrence in bipolar disorder. Journal of affective disorders 82(1):143–147CrossRefGoogle Scholar
  3. 3.
    Cowie R, Douglas-Cowie E, Savvidou S, McMahon E, Sawey M, Schröder M (2000) ‘FEELTRACE’: an instrument for recording perceived emotion in real time. In: ISCA tutorial and research workshop (ITRW) on speech and emotionGoogle Scholar
  4. 4.
    Dias J, Mascarenhas S, Paiva A (2014) Fatima modular: towards an agent architecture with a generic appraisal framework. In: Emotion modeling. Springer, pp. 44–56Google Scholar
  5. 5.
    Diener E, Larsen RJ (1993) The experience of emotional well-beingGoogle Scholar
  6. 6.
    Egges A, Kshirsagar S, Magnenat-Thalmann N (2004) Generic personality and emotion simulation for conversational agents. Computer animation and virtual worlds 15(1):1–13CrossRefGoogle Scholar
  7. 7.
    Hasegawa T, Kaji N, Yoshinaga N, Toyoda M (2013) Predicting and eliciting addressee’s emotion in online dialogue. In: Proceedings of association for computational linguistics, vol 1, pp 964–972Google Scholar
  8. 8.
    Lasguido N, Sakti S, Neubig G, Toda T, Nakamura S (2014) Utilizing human-to-human conversation examples for a multi domain chat-oriented dialog system. Trans Inf Syst 97(6):1497–1505Google Scholar
  9. 9.
    Lee C, Jung S, Kim S, Lee GG (2009) Example-based dialog modeling for practical multi-domain dialog system. Speech Commun 51(5):466–484CrossRefGoogle Scholar
  10. 10.
    McKeown G, Valstar M, Cowie R, Pantic M, Schroder M (2012) The SEMAINE database: annotated multimodal records of emotionally colored conversations between a person and a limited agent. Trans Affect Comput 3(1):5–17CrossRefGoogle Scholar
  11. 11.
    Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161CrossRefGoogle Scholar
  12. 12.
    Scherer KR, Schorr A, Johnstone T (2001) Appraisal processes in emotion: theory, methods, research. Oxford University PressGoogle Scholar
  13. 13.
    Schröder M, Bevacqua E, Cowie R, Eyben F, Gunes H, Heylen D, Maat MT, McKeown G, Pammi S, Pantic M et al (2012) Building autonomous sensitive artificial listeners. Trans Affect Comput 3(2):165–183CrossRefGoogle Scholar
  14. 14.
    Skowron M, Theunis M, Rank S, Kappas A (2013) Affect and social processes in online communication-experiments with an affective dialog system. Trans Affect Comput 4(3):267–279Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  • Nurul Lubis
    • 1
    Email author
  • Sakriani Sakti
    • 1
  • Koichiro Yoshino
    • 1
  • Satoshi Nakamura
    • 1
  1. 1.Graduate School of Information ScienceNara Institute of Science and TechnologyIkomaJapan

Personalised recommendations