MR-Shoppingu: Physical Interaction with Augmented Retail Products Using Continuous Context Awareness

  • Kelvin ChengEmail author
  • Mitsuru Nakazawa
  • Soh Masuko
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10507)


In-store physical shopping experiences are often complemented with searches for product related information on mobile devices. However, there is a distinct gap between the physical reality at the shop and the digital content on mobile devices. At the same time, in the not-too-distant future, we envision a world where mixed-reality technologies become ubiquitous, in much the same way as mobile devices have become today. In this context, we proposed MR-Shoppingu, a novel interactive retail shopping experience by using a combination of continuous context awareness, natural user actions, and augmented physical products with online content. Users can interact with products physically and naturally, and are provided with relevant content and recommendations virtually in mixed-reality. This may help consumers in the purchasing process by increasing efficiency and certainty of purchase, and enabling a more personalized and entertaining shopping experience.


Context awareness Interactive retail shopping Mixed Reality 


  1. 1.
    Azuma, R.T.: A survey of augmented reality. Presence 6(4), 355–385 (1997)CrossRefGoogle Scholar
  2. 2.
    Dacko, S.G.: Enabling smart retail setting via mobile augmented reality shopping apps. Technol. Forecast. Soc. Chang., 1–14 (2016)Google Scholar
  3. 3.
    Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5, 4–7 (2001)CrossRefGoogle Scholar
  4. 4.
    Löchtefeld, M., et al.: ShelfTorchlight: Augmenting a shelf using a camera projector unit. In: Adjunct Proceedings of the 8th International Conference on Pervasive Computing (2010)Google Scholar
  5. 5.
    Välkkynen, P., Boyer, A., Urhemaa, T., Nieminen, R.: Mobile augmented reality for retail environments. In: Proceedings of Workshop on Mobile Interaction in Retail Environments in Conjunction with MobileHCI (2011)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2017

Authors and Affiliations

  1. 1.Rakuten Institute of TechnologyRakuten, Inc.Setagaya, TokyoJapan

Personalised recommendations