Recommendation Effects of a Social Robot for Advertisement-Use Context in a Shopping Mall


We developed a coupon-giving robot system for a shopping mall to explore possible applications using social robots in daily environments, particularly for advertising. The system provided information through conversations with people. The robot was semi-autonomous, which means that it was partly controlled by a human operator, to cope with the difficulty of speech recognition in real environments. We conducted two field trials to investigate two kinds of effectiveness related to recommendations: the presence of a robot and different conversation schemas. Although a robot can strongly attract people with its presence and interaction, it remains unknown whether it can increase the effects of advertisements in real environments. Our field trial results show that a small robot increased the number of people who printed coupons more than a normal-sized robot. The number of people who printed coupons also increased when the robot asked visitors to freely select from all coupon candidates or to listen to its recommendation.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5


  1. 1.

    Kidd C, Breazeal C (2004) Effect of a robot on user perceptions. In: IROS’ 04, pp 3559–3564

    Google Scholar 

  2. 2.

    Powers A, Kiesler S, Fussell SR, Torrey C (2007) Comparing a computer agent with a humanoid robot. In: Human-robot interaction, pp 145–152

    Google Scholar 

  3. 3.

    Mutlu B et al (2006) A storytelling robot: modeling and evaluation of human-like gaze behavior. In: IEEE int conf on humanoid robots, Humanoids, 2006, pp 518–523

    Google Scholar 

  4. 4.

    Kahn PH Jr et al (2008) Design patterns for sociality. In: Human robot interaction, HRI, 2008, pp 97–104

    Google Scholar 

  5. 5.

    Burgard W, Cremers AB, Fox D, Hanel D, Lakemeyer G, Schulz D, Steiner W, Thrun S (1998) The interactive museum tour-guide robot. In: Proc of national conference on artificial intelligence, pp 11–18

    Google Scholar 

  6. 6.

    Siegwart R et al (2003) Robox at expo 02: a large scale installation of personal robots. Robot Auton Syst 42(3):203–222

    Article  MATH  Google Scholar 

  7. 7.

    Gockley R, Forlizzi J, Simmons R (2006) Interactions with a Moody Robot. ACM/IEEE International Conference on Human-Robot Interaction (HRI2006), 186–193

  8. 8.

    Kanda T, Hirano T, Eaton D, Ishiguro H (2004) Interactive robots as social partners and peer tutors for children: a field trial. Hum-Comput Interact 19(1–2):61–84

    Article  Google Scholar 

  9. 9.

    Wada K, Shibata T (2007) Living with seal robots—its sociopsychological and physiological influences on the elderly at a care house. IEEE Trans Robot 23(5):972–980

    Article  Google Scholar 

  10. 10.

    Dautenhahn K, Werry I (2002) A quantitative technique for analyzing robot-human interactions. In: IEEE/RSJ international conference on intelligent robots and systems, IROS, 2002, pp 1132–1138

    Google Scholar 

  11. 11.

    Kozima H, Nakagawa C, Yasuda Y (2005) Interactive robots for communication-care: a case-study in autism therapy. In: IEEE international symposium on robots and human interactive communications, Ro-Man, 2005, pp 341–346.

    Google Scholar 

  12. 12.

    Tanaka F, Cicourel A, Movellan JR (2007) Socialization between toddlers and robots at an early childhood education center. Proc Natl Acad Sci USA 104(46):17954–17958

    Article  Google Scholar 

  13. 13.

    Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2009) An affective guide robot in a shopping mall. In: ACM/IEEE international conference on human-robot interaction, HRI, 2009

    Google Scholar 

  14. 14.

    Shiomi M, Kanda T, Glas DF, Satake S, Ishiguro H, Hagita N (2009) Field trial of networked social robots in a shopping mall. In: The 2009 IEEE/RSJ international conference on intelligent robots and systems, IROS, 2009

    Google Scholar 

  15. 15.

    Glas DF, Kanda T, Ishiguro H, Hagita N (2008) Simultaneous teleoperation of multiple social robots. In: ACM/IEEE international conference on human-robot interaction, HRI, 2008 pp 311–318

    Google Scholar 

  16. 16.

    Fogg BJ (2003) Persuasive technology: using computers to change what we think and do. Morgan Kaufmann, San Mateo

    Google Scholar 

  17. 17.

    Tintarev N, Masthoff J (2007) A survey of explanations in recommender systems. In: Workshop on recommender systems and intelligent user interfaces. Associated with ICDE’07

    Google Scholar 

  18. 18.

    Shinozawa K, Naya F, Yamato J (2005) Differences in effect of robot and screen agent recommendations of human decision-making. Int J Hum-Comput Stud 62:2

    Google Scholar 

  19. 19.

    Bainbridge WA, Hart J, Kim ES, Scassellati B (2008) The effect of presence on human-robot interaction. In: IEEE int symposium on robot and human interactive communication, RO-MAN, 2008, pp 701–706

    Google Scholar 

  20. 20.

    Hiroi Y, Ito A (2011) Influence of the size factor of a mobile robot moving toward a human on subjective acceptable distance. In: Gacovski Z (ed) Mobile robots—current trends, INTECH, pp 177–190

    Google Scholar 

  21. 21.

    Kanda T et al (2008) Who will be the customer? A social robot that anticipates people’s behavior from their trajectories. In: UbiComp2008

    Google Scholar 

  22. 22.

    Lee MK, Kiesler S, Forlizzi J (2010) Receptionist or information kiosk? How do people talk with a robot? In: Proceedings of CSCW 2010, pp 31–40

    Google Scholar 

  23. 23.

    Abelson RP (1981) Psychological status of the script concept. Am Psychol 36(7):715–729

    Article  Google Scholar 

  24. 24.

    Fischer K (2006) The role of users’ preconceptions in talking to computers and robots. In: Proceedings of the workshop on ‘How people talk to computers, robots, and other artificial communication partners’, pp 112–130

    Google Scholar 

  25. 25.

    Dahlback D, Jonsson A, Ahrenberg L (1993) Wizard of oz studies-why and how. Knowl-Based Syst 6(4):258–266

    Article  Google Scholar 

  26. 26.

    Kawai H, Toda T, Ni J, Tsuzaki M, Tokuda K (2004) XIMERA: a new TTS from ATR based on corpus-based technologies. In: Proc of fifth ISCA workshop on speech synthesis, SSW5, pp 179–184

    Google Scholar 

  27. 27.

    Sakamoto D et al (2009) Humanoid robots as a broadcasting communication medium in open public spaces. Int J Soc Robot 1(2):157–169

    Article  Google Scholar 

  28. 28.

    Hartnett JJ, Bailey KG, Hartley CS (1974) Body height, position, and sex as determinants of personal space. J Psychol, Interdiscip Appl 87(1):129–136

    Article  Google Scholar 

  29. 29.

    Hiroi Y, Ito A (2011) Influence of the size factor of a mobile robot moving toward a human on subjective acceptable distance. In: Gacovski Z (ed) Mobile robots—current trends, INTECH, pp 177–190

    Google Scholar 

  30. 30.

    Kanda T, Ishiguro H, Imai M, Ono T (2004) Development and evaluation of interactive humanoid robots. Proc IEEE 92(11):1839–1850

    Article  Google Scholar 

  31. 31.

    Sakamoto D, Kanda T, Ono T, Ishiguro H, Hagita N (2007) Android as a telecommunication medium with a human-like presence. In: ACM/IEEE international conference on human-robot interaction, pp 193–200

    Google Scholar 

Download references


We thank the staff of the Asia and Pacific Trade Center Co., Ltd. for their kind cooperation. This research was supported by the Ministry of Internal Affairs and Communications of Japan.

Author information



Corresponding author

Correspondence to Masahiro Shiomi.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Shiomi, M., Shinozawa, K., Nakagawa, Y. et al. Recommendation Effects of a Social Robot for Advertisement-Use Context in a Shopping Mall. Int J of Soc Robotics 5, 251–262 (2013).

Download citation


  • Social robot
  • Advertisement
  • Field trial