Personal Greetings: Personalizing Robot Utterances Based on Novelty of Observed Behavior
- 432 Downloads
One challenge in creating conversational service robots is how to reproduce the kind of individual recognition and attention that a human can provide. We believe that interactions can be made to seem more warm and humanlike by using sensors to observe a person’s behavior or appearance over time, and programming the robot to comment when it observes a novel feature, such as a new hairstyle, or a consistent behavior, such as visiting every afternoon. To create a system capable of recognizing such novelty and typicality, we collected one month of training data from customers in a shopping mall and recorded features of people’s visits, such as time of day and group size. We then trained SVM classifiers to identify each feature as novel, typical, or neither, based on the inputs of a human coder, and we trained an additional classifier to choose an appropriate topic for a personalized greeting. An utterance generator was developed to generate text for the robot to speak, based on the selected topic and sensor data. A cross-validation analysis showed that the trained classifiers could accurately reproduce human novelty judgments with 88% accuracy and topic selection with 95% accuracy. We then deployed a teleoperated robot using this system to greet customers in a shopping mall for three weeks, and we present example interactions and results from interviews showing that customers appreciated the robot’s personalized greetings and felt a sense of familiarity with the robot.
KeywordsHuman–robot interaction Social robots Novelty detection Greetings Personalized interaction
We would like to thank Dr. Satoshi Koizumi, Tony Han, Benoit Toulmé, Peace Cho, and the management of the APiTA Town Keihanna shopping mall for their help in the organization and execution of the data collection.
Conflict of interest
The authors declare that they have no conflicts of interest.
This research was conducted in compliance with the standards and regulations of our company’s ethical review board, which requires every experiment we conduct to be subject to a review and approval procedure according to strict ethical guidelines.
- 1.Friedman B, Kahn PH, Hagman J (2003) Hardware companions?-What online AIBO discussion forums reveal about the Human-Robotic relationship. Paper presented at the ACM conference on human factors in computing systems (CHI2003)Google Scholar
- 4.Sabelli AM, Kanda T, Hagita N (2011) A conversational Robot in an Elderly Care Center: an Ethnographic Study. Paper presented at the ACM/IEEE international conference on human-robot interaction (HRI2011)Google Scholar
- 5.Eyssel F, Reich N (2013) Loneliness makes the heart grow fonder (of robots)—on the effects of loneliness on psychological anthropomorphism. In: 8th ACM/IEEE international conference on human-robot interaction (HRI), pp 121–122Google Scholar
- 7.Gockley R, Bruce A, Forlizzi J, Michalowski M, Mundell A, Rosenthal S, Sellner B, Simmons R, Snipes K, Schultz AC, Jue W (2005) Designing robots for long-term social interaction. In: Intelligent robots and systems (IROS 2005). 2005 IEEE/RSJ international conference on, 2-6 Aug. 2005, pp 1338-1343. doi: 10.1109/iros.2005.1545303
- 8.Leite I, Castellano G, Pereira A, Martinho C, Paiva A (2012) Long-term interactions with empathic robots: evaluating perceived support in children. Soc Robot 298–307Google Scholar
- 9.Kidd CD (2008) Designing for long-term human-robot interaction and application to weight loss. Massachusetts Institute of Technology, Cambridge, MAGoogle Scholar
- 11.Riek LD, Paul PC, Robinson P (2009) When my robot smiles at me: enabling human-robot rapport via real-time head gesture mimicry. J Multimodal User Interfaces 3(1–2):99–108Google Scholar
- 13.Sabelli AM, Kanda T, Hagita N (2011) A conversational robot in an elderly care center: an ethnographic study. In: 6th ACM/IEEE international conference on human-robot interaction (HRI), 8-11 March 2011, pp 37–44Google Scholar
- 22.Lao S, Kawade M (2005) Vision-based face understanding technologies and their applications. In: Li SZ, Lai J, et al. (eds) Advances in biometric person authentication. Springer, New York, pp 339–348Google Scholar
- 24.Chang CC, Lin CJ (2001) LIBSVM: a library for support vector machinesGoogle Scholar
- 25.Shiwa T, Kanda T, Imai M, Ishiguro H, Hagita N How quickly should communication robots respond? In: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction, Amsterdam, The Netherlands, 2008. ACM, pp 153-160. doi: 10.1145/1349822.1349843