Skip to main content
SpringerLink
Log in

User-Centered Design and Evaluation of a Mobile Shopping Robot

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

This paper describes the user-centered design and evaluation process of a humanoid mobile shopping robot named TOOMAS that assists customers of home improvement stores. Three separate empirical field studies addressing the robot’s usability (according to ISO 9241-11) and acceptability (intention to use) are presented involving \(N=343\) test persons altogether. The first formative evaluation study (\(N\!=\!210\)) addresses the usability of the robot’s article search system. It is demonstrated how several usability problems could be identified and eliminated, leading to significantly more successful article searches. The second formative evaluation study (\(N\!=\!39\)) addresses the robot’s adaptation to its specific task and role in the home improvement store. Embodiment, mobility, voice output, and social behavior were analyzed and adapted to user requirements. The third summative evaluation study (\(N=94\)) experimentally tested robot-assisted shopping against conventional shopping regarding core usability criteria (effectiveness, efficiency, and satisfaction). It reveals that robot-assisted shopping was as effective and satisfactory as conventional shopping. Still, at the current state of technology shopping with robot assistance was slightly slower and therefore less efficient. For all three studies the effects of users’ gender, age, educational background and computer skills levels on robot usability and acceptability are presented and discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Bartneck C, Forlizzi J (2004) A design-centred framework for social human-robot interaction. In: The 13th IEEE international workshop on robot and human interactive communication, RO-MAN 2004, pp 591–594

  2. Beer JM, Prakash A, Mitzner TL, Rogers WA (2011) Understanding robot acceptance. Tech. Rep. HFA-TR-1103, Georgia Institute of Technology, School of Psychology, Human Factors and Aging Laboratory, Atlanta, GA

  3. Bischoff R, Graefe V (2004) Design principles for dependable robotic assistants. Int J Hum Robot 1(1):95–125

    Article  Google Scholar 

  4. Böhme HJ, Scheidig A, Wilhelm T, Schröter C, Martin C, König A, Müller S, Gross HM (2006) Progress in the development of an interactive mobile shopping assistant. In: Proceedings of the joint conference on robotics: 37th international symposium on robotics, ISR 2006, and 4th German conference on robotics, Robotik 2006, Paper no. 38

  5. Bryman A (2008) Social research methods, 3rd edn. Oxford University Press Inc., New York

    Google Scholar 

  6. Butler JT, Agah A (2001) Psychological effects of behavior patterns of a mobile personal robot. Auton Robot 10(2):185–202

    Article  MATH  Google Scholar 

  7. Datta C, Kapuria A, Vijay R (2011) A pilot study to understand requirements of a shopping mall robot. In: The 6th ACM/IEEE international conference on human–robot interaction, HRI 2011, pp 127–128. doi:10.1145/1957656.1957694

  8. Datta C, Vijay R (2010) Neel: An intelligent shopping guide using web data for rich interactions. In: The 5th ACM/IEEE international conference on human–robot interaction, HRI 2010, pp 87–88

  9. Decker M, Dillmann R, Dreier T, Fischer M, Gutmann M, Ott I, Spiecker genannt Dömann I (2011) Service robotics: do you know your new companion? Framing an interdisciplinary technology assessment. Poiesis Prax 8:25–44. doi:10.1007/s10202-011-0098-6

    Article  Google Scholar 

  10. Gai S, Jung EJ, Yi BJ (2013) Mobile shopping cart application using kinect. In: Proceedings of the 10th international conference on ubiquitous robots and ambient intelligence, URAI 2013, pp 289–291. doi:10.1109/URAI.2013.6677370

  11. Garcia-Arroyo M, Marin-Urias LF, Marin-Hernandez A, GdJ Hoyos-Rivera (2012) Design, integration, and test of a shopping assistance robot system. In: The seventh annual ACM/IEEE international conference on human–robot interaction, HRI 2012, pp 135–136. doi:10.1145/2157689.2157722

  12. Gharpure C, Kulyukin V (2008) Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intell Serv Robot 1(3):237–251. doi:10.1007/s11370-008-0020-9

    Article  Google Scholar 

  13. Gharpure C, Kulyukin VA, Kutiyanawala A (2006) A robotic shopping assistant for the blind: A pilot study (Technical Report USU-CSATL-1-01-06, Computer Science). Tech. rep., Assistive Technology Laboratory, Department of Computer Science, Utah State University, Logan

  14. Göller M, Kerscher T, Zöllner JM, Dillmann R, Devy M, Germa T, Lerasle F (2009) Setup and control architecture for an interactive shopping cart in human all day environments. In: Proceedings of the 14th international conference on advanced robotics, ICAR 2009, pp 1–6

  15. Göller M, Steinhardt F, Kerscher T, Dillmann R, Devy M, Germa T, Lerasle F (2010) Sharing of control between an interactive shopping robot and it’s user in collaborative tasks. In: The 19th IEEE international symposium on robot and human interactive communication, ROMAN 2010, pp 626–631

  16. Gross HM, Böhme HJ (2000) Perses - a vision-based interactive mobile shopping assistant. In: The 2000 IEEE international conference on systems, man, and cybernetics, SCM 2000, vol 1, pp 80–85

  17. Gross HM, Böhme HJ, Schröter C, Müller S, König A, Einhorn E, Martin C, Merten M, Bley A (2009) TOOMAS: Interactive shopping guide robots in everyday use - final implementation and experiences from long-term field trials. In: The 22nd IEEE/RSJ international conference on intelligent robots and systems, IROS 2009, p 20052012

  18. Gross HM, Böhme HJ, Schröter C, Müller S, König A, Martin C, Merten M, Bley A (2008) Shopbot: progress in developing an interactive mobile shopping assistant for everyday use. In: The 2008 IEEE international conference on systems, man and cybernetics, SCM 2008, p 34713478

  19. Gross HM, Koenig A, Schroeter C, Boehme HJ (2003) Omnivision-based probabilistic self-localization for a mobile shopping assistant continued. In: The 16th IEEE/RSJ international conference on intelligent robots and systems, IROS 2003, pp 1505–1511

  20. Hornbaek K (2006) Current practice in measuring usability: challenges to usability studies and research. Int J Hum Comput Stud 64(2):79–102. doi:10.1016/j.ijhcs.2005.06.002

    Article  Google Scholar 

  21. Ichbiah D (2005) From science fiction to technological revolution. Harry N. Abrams, New York

    Google Scholar 

  22. International Federation of Robotics (IFR): Executive summary—world robotics 2013 service robots (2013). http://www.ifr.org/uploads/media/Executive_Summary_WR_2013_01.pdf. Accessed 30 April 2014

  23. Iwamura Y, Shiomi M, Kanda T, Ishiguro H, Hagita N (2011) Do elderly people prefer a conversational humanoid as a shopping assistant partner in supermarkets? In: The 6th ACM/IEEE international conference on human–robot interaction, HRI 2011, pp 449–456

  24. Jung J, Kanda T, Kim MS (2013) Guidelines for contextual motion design of a humanoid robot. Int J Soc Robot 5(2):153–169. doi:10.1007/s12369-012-0175-6

    Article  Google Scholar 

  25. Kamei K, Ikeda T, Kidokoro H, Shiomi M, Utsumi A, Shinozawa K, Miyashita T, Hagita N (2011) Effectiveness of cooperative customer navigation from robots around a retail shop. In: The 3rd IEEE international conference on privacy, security, risk and trust, PASSAT 2011; and 3rd IEEE international conference on social computing, SOCIALCOM 2011, pp 235–241

  26. Kamei K, Shinozawa K, Ikeda T, Utsumi A, Miyashita T, Hagita N (2010) Recommendation from robots in a real-world retail shop. In: Proceedings of the international conference on multimodal interfaces and the workshop on machine learning for multimodal interaction, ICMI-MLMI 2010, pp 19:1–19:8

  27. Kanda T, Glas DF, Shiomi M, Hagita N (2009) Abstracting people’s trajectories for social robots to proactively approach customers. IEEE Trans Robot 25(6):1382–1396

    Article  Google Scholar 

  28. Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2009) An affective guide robot in a shopping mall. In: 4th ACM/IEEE international conference on human–robot interaction, HRI 2009, pp 173–180

  29. Kanda T, Shiomi M, Miyashita Z, Ishiguro H, Hagita N (2010) A communication robot in a shopping mall. IEEE Trans Robot 26(5):897–913

    Article  Google Scholar 

  30. Kidokoro H, Kamei K, Shinozawa K, Miyashita T, Hagita N (2011) You stopped by there? I recommend this:Changing customer behaviors with robots. In: The 13th international conference on ubiquitous computing, UbiComp 2011, pp 569–570

  31. Kirchner N, Alempijevic A (2012) A robot centric perspective on hri. J Hum-Robot Interact 1:135–157

    Google Scholar 

  32. Kitade T, Satake S, Kanda T, Imai M (2013) Understanding suitable locations for waiting. In: The 8th ACM/IEEE international conference on human–robot interaction, HRI 2013, pp 57–64. doi:10.1109/HRI.2013.6483502

  33. Kohtsuka T, Onozato T, Tamura H, Katayama S, Kambayashi Y (2011) Design of a control system for robot shopping carts. In: König A, Dengel A, Hinkelmann K, Kise K, Howlett R, Jain L (eds) Knowledge-based and intelligent information and engineering systems, lecture notes in computer science, vol 6881. Springer, Berlin, pp 280–288

    Chapter  Google Scholar 

  34. Kulyukin VA, Gharpure C (2006) Ergonomics-for-one in a robotic shopping cart for the blind. In: 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 142–149

  35. Kulyukin VA, Gharpure C, Nicholson J, Pavithran S (2004) RFID in robot-assisted indoor navigation for the visually impaired. In: The 17th IEEE/RSJ international conference on intelligent robots and systems, IROS 2004, pp 1979–1984

  36. Kulyukin VA, Gharpure C, Pentico C (2007) Robots as interfaces to haptic and locomotor spaces. In: The 2nd ACM/IEEE international conference on human–robot interaction, HRI 2007, pp 325–331

  37. Kuo IH, Jayawardena C, Broadbent E, MacDonald B (2011) Multidisciplinary design approach for implementation of interactive services. Int J Soc Robot 3(4):443–456. doi:10.1007/s12369-011-0115-x

    Article  Google Scholar 

  38. Leite I, Martinho C, Paiva A (2013) Social robots for long-term interaction: a survey. Int J Soc Robot 5(2):291–308. doi:10.1007/s12369-013-0178-y

    Article  Google Scholar 

  39. Liu P, Glas D, Kanda T, Ishiguro H, Hagita N (2013) It’s not polite to point - Generating socially-appropriate deictic behaviors towards people. In: The 8th ACM/IEEE international conference on human–robot interaction, HRI 2013, pp 267–274. doi:10.1109/HRI.2013.6483598

  40. Lohse M (2007) Nutzerfreundliche Mensch-Roboter-Interaktion. Kriterien für die Gestaltung von Personal Service Robots (in German). VDM Verlag Dr. Müller, Saarbrücken

  41. Ludewig Y, Doering N, Exner N (2012) Design and evaluation of the personality trait extraversion of a shopping robot. In: The 21st IEEE international symposium on robot and human interactive communication, RO-MAN 2012, pp 372–379. doi:10.1109/ROMAN.2012.6343781

  42. Ludewig Y, Poeschl S, Doering N, Gross HM (2011) Shopping robots in home improvement stores: evaluation of usability and user acceptance of a mobile shopping robot. In: Proceedings of the international HRI pioneers workshop, 2011, pp 66–67

  43. Marin-Hernandez A, de Jesus Hoyos-Rivera G, Garcia-Arroyo M, Marin-Urias L (2012) Conception and implementation of a supermarket shopping assistant system. In: Proceedings of the 11th Mexican international conference on artificial intelligence, MICAI 2012, pp 26–31. doi:10.1109/MICAI.2012.21

  44. Matsuhira N, Ozaki F, Tokura S, Sonoura T, Tasaki T, Ogawa H, Sano M, Numata A, Hashimoto N, Komoriya K (2010) Development of robotic transportation system - shopping support system collaborating with environmental cameras and mobile robots. In: Proceedings of the 41st international symposium and 6th German conference on robotics, ROBOTIK 2010, pp 1–6

  45. Matsumoto T, Satake S, Kanda T, Imai M, Hagita N (2012) Do you remember that shop? - Computational model of spatial memory for shopping companion robots. In: The 7th ACM/IEEE International conference on human–robot interaction, HRI 2012, pp 447–454

  46. Mori M, MacDorman K, Kageki N (2012) On the uncanny valley. IEEE Robot Automat Mag 10(2):98–100

    Article  Google Scholar 

  47. Mueller S, Schaffernicht A, Scheidig A, Boehme HJ, Gross HM (2007) Are you still following me? Proceedings of the European conference on mobile robots, ECMR 2007, pp 211–216

  48. Nakagawa K, Shiomi M, Shinozawa K, Matsumura R, Ishiguro H, Hagita N (2012) Effect of robot’s whispering behavior on people’s motivation. Int J Soc Robot 1–12. doi:10.1007/s12369-012-0141-3

  49. Nakagawa K, Shiomi M, Shinozawa K, Matsumura R, Ishiguro H, Hagita N (2013) Effect of robot’s whispering behavior on people’s motivation. Int J Soc Robot 5(1):5–16. doi:10.1007/s12369-012-0141-3

    Article  Google Scholar 

  50. Nishimura S, Takemura H, Mizoguchi H (2007) Development of attachable modules for robotizing daily items—person following shopping cart robot. The IEEE international conference on robotics and biomimetics, ROBIO 2007, pp 1506–1511

  51. Oppermann R, Reiterer H (1997) Software evaluation using the 9241 evaluator. Behav Inf Technol 16(4/5):232–245

    Article  Google Scholar 

  52. Pacchierotti E, Christensen HI, Jensfelt P (2005) Human-robot embodied interaction in hallway settings: a pilot user study. In: The IEEE international workshop on robot and human interactive communication, ROMAN 2005, p 164171

  53. Pöschl S, Döring N, Böhme HJ, Martin C (2008) Computergestützte Artikelsuche im Baumarkt. Formative Evaluation eines Artikelsuchsystems für mobile Shopping-Roboter (in German). Z für Eval 7(1):113–135

    Google Scholar 

  54. Pöschl S, Döring N, Böhme HJ, Martin C (2009) Mensch-Roboter-Interaktion im Baumarkt. Formative Evaluation eines mobilen Shopping-Roboters (in German). Z für Eval 8(1):27–58

    Google Scholar 

  55. Pöschl S, Döring N, Gross HM, Bley A, Martin C, Böhme HJ (2011) Roboter-gestützte Artikelsuche im Baumarkt. Eine Studie zu summativer Evaluation und Nutzerakzeptanz eines mobilen Shopping-Assistenten (in German). Z für Eval 10(1):99–132

    Google Scholar 

  56. Powers A (2008) Feature: what robotics can learn from HCI. Interactactions 15(2):67–69

    Article  MathSciNet  Google Scholar 

  57. Reeves B, Nass C (1996) The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, New York

    Google Scholar 

  58. Schraft RD, Schmierer G (2000) Service robots. Peters, Wellesley

    Google Scholar 

  59. Schroeter C, Boehme HJ, Gross HM (2007) Memory-efficient grid maps in RBPF for SLAM using sonar range sensors. In: Proceedings of the 3rd European conference on mobile robots, ECMR 2007, pp 138–143

  60. Schroeter C, Gross HM (2008) A sensor-independent approach to RBPF SLAM—map match SLAM applied to visual mapping. In: The IEEE/RSJ 2008 international conference on intelligent robots and systems, IROS 2008, pp 2078–2083

  61. Scriven M (1967) The methodology of evaluation. In: Tyler RW, Gagne RM, Scriven M (eds) Perspectives of curriculum evaluation. Rand McNally, Chicago, pp 39–83

    Google Scholar 

  62. Shiomi M, Kanda T, Glas D, Satake S, Ishiguro H, Hagita N (2009) Field trial of networked social robots in a shopping mall. In: The IEEE/RSJ 2009 international conference on intelligent robots and systems, IROS 2009, pp 2846–2853

  63. Shiomi M, Kanda T, Nohara K, Ishiguro H, Hagita N (2009) Adaptive supervisory control of a communication robot that approaches visitors. In: Asama H, Kurokawa H, Ota J, Sekiyama K (eds) Distributed autonomous robotic systems 8. Springer, Berlin, pp 555–564

    Chapter  Google Scholar 

  64. Shiomi M, Shinozawa K, Nakagawa Y, Miyashita T, Sakamoto T, Terakubo T, Ishiguro H, Hagita N (2013) Recommendation effects of a social robot for advertisement-use context in a shopping mall. Int J Soc Robot 5(2):251–262. doi:10.1007/s12369-013-0180-4

    Article  Google Scholar 

  65. Shiomi M, Zanlungo F, Hayashi K, Kanda T (2014) Towards a socially acceptable collision avoidance for a mobile robot navigating among pedestrians using a pedestrian model. Internat J of Soc Robot 1–13. doi:10.1007/s12369-014-0238-y

  66. Sucar OI, Aviles S, Miranda-Palma C (2003) From HCI to HRI - usability inspection in multimodal human-robot interactions. In: The 12th IEEE international workshop on robot and human interactive communication, ROMAN 2003, pp 37–41

  67. Tokura S, Sonoura T, Tasaki T, Matsuhira N, Sano M, Komoriya K (2009) Robotic transportation system for shopping support services. In: The 18th IEEE international symposium on robot and human interactive communication, RO-MAN 2009, p 320

  68. Tomizawa T, Ohba K, Ohya A, Yuta S (2007) Remote food shopping robot system in a supermarket - realization of the shopping task from remote places. In: Proceedings of the international conference on mechatronics and automation, ICMA 2007, pp 1771–1776

  69. Tomizawa T, Ohya A, Yuta S (2006) Remote shopping robot system, -development of a hand mechanism for grasping fresh foods in a supermarket. In: The IEEE/RSJ 2006 international conference on intelligent robots and systems, IROS 2006, pp 4953–4958

  70. Venkatesh V, Morris MG, Davis GB, Davis FD (2003) User acceptance of information technology: toward a unified view. MIS Q 27(3):425–478

  71. Vijay, R., Kapuria, A., Datta, C., Dubey, G., Sharma, C., Taank, G. (2012) Ecosystem of a shopping mall robot—neel. In: Proceedings of the 9th international conference on ubiquitous robots and ambient intelligence, URAI 2012, pp 120–125. doi:10.1109/URAI.2012.6462949

  72. Yanco HA, Drury JL, Scholtz J (2004) Beyond usability evaluation: Analysis of human–robot interaction at a major robotics competition. Hum Comput Interact 19(1–2):117–149

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Yvonne Ludewig, Gesine Märten, Carina Meixner, Frauke Posselt, Susann Räcke, Jenny Reichenbacher, Uwe Sonderhoff, Julia Wolf, and Cornelia Zinner for their help in organizing and conducting the studies. The authors thank toom Baumarkt GmbH for their support with conducting the field trials and their institutional support with the SERROKON project.

Author information

Authors and Affiliations

  1. Institute of Media and Communication Science, Media Psychology and Media Design Group, Technische Universität Ilmenau, P.O.B. 10 05 65, 98684, Ilmenau, Germany

    Nicola Doering & Sandra Poeschl

  2. Neuroinformatics and Cognitive Robotics Lab, Department of Computer Science and Automation, Technische Universität Ilmenau, P.O.B. 10 05 65, 98684, Ilmenau, Germany

    Horst-Michael Gross

  3. MetraLabs Neue Technologien und Systeme GmbH, Am Vogelherd 22, 98693, Ilmenau, Germany

    Andreas Bley & Christian Martin

  4. Faculty of Information Technology/Mathematics, University of Applied Sciences Dresden, P.O.B. 12 07 01, 01008, Dresden, Germany

    Hans-Joachim Boehme

Authors
  1. Nicola Doering
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sandra Poeschl
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Horst-Michael Gross
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andreas Bley
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christian Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hans-Joachim Boehme
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sandra Poeschl.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Doering, N., Poeschl, S., Gross, HM. et al. User-Centered Design and Evaluation of a Mobile Shopping Robot. Int J of Soc Robotics 7, 203–225 (2015). https://doi.org/10.1007/s12369-014-0257-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-014-0257-8

Keywords

Search

Navigation