Experimental Study on Estimation of Opportune Moments for Proactive Voice Information Service Based on Activity Transition for People Living Alone

  • Mitsuki Komori
  • Yuichiro Fujimoto
  • Jianfeng Xu
  • Kazuyuki Tasaka
  • Hiromasa Yanagihara
  • Kinya FujitaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11566)


Smart speakers that listen to a user’s commands and respond vocally are being used in homes across the world. Making smart speakers proactive by delivering information without an explicit command from the user might extend their applications and benefit users. However, such improvements also pose a risk for disturbing users. Therefore, this study aims at developing technology for estimating the opportune moments for information delivery without disturbing the user’s daily activity. To analyze the subjective acceptability of users at home, we prototyped an experimental system that detects the activity transitions of participants based on his/her location and body motion using a depth camera and vocally asks his/her acceptability for information delivery at that moment. We conducted an experiment with three participants that lived alone. The results suggested that the acceptability of users relates to the activity patterns both before and after activity transition.


Smart speaker Acceptability Proactive service Depth camera Notification 


  1. 1.
    Google Home. Accessed 1 Dec 2018
  2. 2.
  3. 3.
    Mark, G.J., Gonzalez, V.M., Harris, J.: No task left behind? Examining the nature of fragmented work. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 321–330. ACM, New York (2005)Google Scholar
  4. 4.
    Iqbal, S.T., Bailey, B.P.: Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1489–1492. ACM, New York (2005)Google Scholar
  5. 5.
    Porcheron, M., Fischer, J.E., Reeves, S., Sharples, S.: Voice interface in everyday life. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, p. 640. ACM, New York (2018)Google Scholar
  6. 6.
    Luria, M., Hoffman, G., Zuckerman, O.: Comparing social robot, screen and voice interfaces for smart-home control. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 580–592. ACM, New York (2017)Google Scholar
  7. 7.
    Takemae, Y., Chaki, S., Ohno, T., Yoda, I., Ozawa, S.: Analysis of human interruptibility in the home environment. In: Extended Abstracts on Human Factors in Computing Systems, pp. 2681–2686. ACM, New York (2007)Google Scholar
  8. 8.
    Cumin, J., Lefebvre, G., Ramparany, F., Crowley, J.: Inferring availability for communication in smart homes using context. In: IEEE International Conference on Pervasive Computing and Communications (PerCom) Workshops (2018)Google Scholar
  9. 9.
    Vastenburg, M.H., Keyson, D.V., de Ridder, H.: Considerate home notification systems: a field study of acceptability of notifications in the home. Pers. Ubiquit. Comput. 12(8), 555–566 (2008)CrossRefGoogle Scholar
  10. 10.
    Tanaka, T., Fukazawa, S., Takeuchi, K., Nonaka, M., Fujita, K.: Study of uninterruptibility estimation method for office worker during PC work. J. Inf. Process. Soc. Jpn. 53(1), 126–137 (2012)Google Scholar
  11. 11.
    Banerjee, S., Silva, A., Feigh, K., Chernova, S.: Effects of interruptibility-aware robot behavior. arXiv:1804.06383 (2018)
  12. 12.
    Fujimoto, Y., Komori, M., Xu, J., Tasaka, K., Yanagihara, H., Fujita, K.: Preliminary study on modeling opportune time for proactive auditory information service. In: Proceedings of the 80th National Convention of Information Processing Society of Japan, 5E-03. IPSJ, Tokyo (2018)Google Scholar
  13. 13.
    Shotton, J., et al.: Real-time human pose recognition in parts from single depth images. Commun. ACM 56(1), 116–124 (2013)CrossRefGoogle Scholar
  14. 14.
    Fujimoto, Y., Nagasawa, Y., Xu, J., Tasaka, K., Yanagihara, H., Fujita, K.: Possibility of estimation on information provision based on body movement toward push-type information service. In: Proceedings of Human Interface Symposium, 7D1-5. HIS, Kyoto (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Mitsuki Komori
    • 1
  • Yuichiro Fujimoto
    • 1
  • Jianfeng Xu
    • 2
  • Kazuyuki Tasaka
    • 2
  • Hiromasa Yanagihara
    • 2
  • Kinya Fujita
    • 1
    Email author
  1. 1.Graduate SchoolTokyo University of Agriculture and TechnologyKoganei, TokyoJapan
  2. 2.KDDI Research Inc.Fujimino, SaitamaJapan

Personalised recommendations