Skip to main content

A TV Chat Robot with Time-Shifting Function for Daily-Use Communication

Part of the Lecture Notes in Computer Science book series (LNAI,volume 10652)


This paper attempts to improve a chatting robot that enables to chat with a user while the user is watching television programs. Previously developed robot interacts with two problems because it utters chat sources from social media such as Twitter. Firstly, it is delayed with a few seconds between the contents of TV program and social media comments, so what robot’s utterance doesn’t relate to the scene being broadcast. Secondly, there is overlap between the utterance of TV and the robot. These problems often make users discomfort when they want to continue to daily-use communication. Therefore, this paper introduces the time-shifting method allowing to improve both problems simultaneously. The experiments for using subjective evaluation by 12 subjects and three kinds of TV program are conducted to compare the robot applied time-shifted and previous one. The results show that the robot with time shifting improves user satisfaction in terms of the synchronization of TV scenes and chat sources.


  • Chat robot
  • Watching television
  • Social media
  • Daily communication
  • Time-shifting

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


  1. Cabinet Office Government of Japan Annual Report on the Aging Society (2014)

    Google Scholar 

  2. Pollack, M.: Intelligent technology for an aging population: the use of AI to assist elders with cognitive impairments. AI Mag. 26(2), 9–24 (2005)

    Google Scholar 

  3. Huang, H., Shibusawa, S., Hayashi, Y., Kawagoe, K.: Proposal of a numeric model of mutual evaluation between the participants in dyadic active listening conversation for developing listener agents. J. Hum. Interface Soc. 18(4), 65–76 (2016)

    Google Scholar 

  4. Cabinet Office Government of Japan Annual Report on the Child and Youth (2016)

    Google Scholar 

  5. Minami, H., Kawanami, H., Kanbara, M., Hagita, N.: Chat robot coupling machine responses and social media comments for communication conversation. In: MUST-EH (2016)

    Google Scholar 

  6. Miyazawa, K., Tokoyo, T., Masui, Y., Matsuo, N., Kikuchi, H.: Factors of interaction in the spoken dialogue system with high desire of sustainability. Trans. IE-ICE (A) 95(1), 27–36 (2012)

    Google Scholar 

  7. Matsubara, D., Ueda, H.: A robot listening to users’ grumble. IEICE Technical report MVE, vol. 111, No. 38, pp. 45–50 (2011)

    Google Scholar 

  8. DOCOMO to Launch Shabette Concier Voice-agent Application, NTT DOCOMO

    Google Scholar 

  9. Kobayashi, Y., Yamamoto, D., Yokoyama, S.: Design targeting voice interface robot capable of active listening. In: Proceedings HRI 2010, pp. 161–162 (2010)

    Google Scholar 

  10. Yoshida, Y., Hagiwara, M.: A dialogue system with humor using multiple linguistic resources. J. Japan Soc. Fuzzy Theory Intell. Inform. 26(2), 627–636 (2014)

    Google Scholar 

  11. Takahashi, T., Kanbara, M., Hagita, N.: A social media mediation robot to increase an opportunity of conversation for elderly: mediation experiments using single or multiple robots. IEICE Technical report CNR, vol. 113, No. 84, pp. 31–36 (2013)

    Google Scholar 

  12. Japanese TTS system: Open JTalk. Accessed 12 Sep 2017

  13. SPTK working group: Examples for Using Speech Signal Processing Toolkit Ver. 3.9 (2015)

    Google Scholar 

Download references


This work was supported by the JSPS Foundation 15K00272 and Research Complex Promotion Program. The authors would like to thank them.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Shogo Nishimura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Nishimura, S., Kawanami, H., Kanbara, M., Hagita, N. (2017). A TV Chat Robot with Time-Shifting Function for Daily-Use Communication. In: Kheddar, A., et al. Social Robotics. ICSR 2017. Lecture Notes in Computer Science(), vol 10652. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70021-2

  • Online ISBN: 978-3-319-70022-9

  • eBook Packages: Computer ScienceComputer Science (R0)