Bridging Offline and Online World Through Augmentable Smart Glass Interfaces

  • Zulqarnain Rashid
  • Joan Melià-Seguí
  • Rafael Pous
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9254)


Online shopping is gaining momentum over offline shopping. Online shopping offers more features and engaging experience as compared to offline one. Bridging online features to brick-and-mortar shopping would benefit user experience. We propose Augmented Reality interfaces developed for smart glass, linked to a physical Smart Space to bridge offline and online world. Empirical testing in the laboratory demonstrates that the user is able to interact with the products in the physical spaces while having access to all the online shopping features. System is tested and validated with 150 tagged products at Radio Frequency based smart shelf, achieving 99 % accuracy in product identification.


Augmented reality Smart glass RFID Intelligent interfaces Human computer interaction Ubiquitous computing 



This paper was partially supported by the ICT PhD program of Universitat Pompeu Fabra through a travel grant.


  1. 1.
    Pous, R., Melià-Seguí, J., Carrerasc, A., Morenza, M., Rashid, Z.: Cricking: customer-product interaction in retail using pervasive technologies. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, UbiComp 2013 Adjunct, pp. 1023–1028. ACM, New York (2013)Google Scholar
  2. 2.
    Rashid, Z., Pous, R., Melià-Seguí, J., Morenza, M.: Mobile augmented reality for browsing physical spaces. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, UbiComp 2014 Adjunct, pp. 155–158. ACM, New York (2014)Google Scholar
  3. 3.
    Merrill, M., Maes, P.: Augmenting looking, pointing and reaching gestures to enhance the searching and browsing of physical objects. In: LaMarca, A., Langheinrich, M., Truong, K.N. (eds.) Pervasive 2007. LNCS, vol. 4480, pp. 1–18. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  4. 4.
    Lupiana, D., O’Driscoll, C., Mtenzi, F.: Taxonomy for ubiquitous computing environments. In: First International Conference on Networked Digital Technologies, NDT 2009, pp. 469–475 (2009)Google Scholar
  5. 5.
  6. 6.
  7. 7.
    K-Pin, C., Dholakia, R.: Factors driving consumer intention to shop online: an empirical investigation. J. Consum. Psychol. 13(1), 177–183 (2003)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Shopping Behavior.
  10. 10.
    Chen, D., Tsai. S., Hsu, C.-H., Jatinder, S., Boris, G.: Mobile augmented reality for books on a shelf. In: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, ICME 2011, pp. 1–6. IEEE Computer Society, Washington (2011)Google Scholar
  11. 11.
    Valkkynen, P., Niemela, M., Tuomisto, T.: Evaluating touching and pointing with a mobile terminal for physical browsing. In: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, NordiCHI 2006, pp. 28–37. ACM (2006)Google Scholar
  12. 12.
    Gerrit, K., Stefan, W., Pascal, L., Spassova, L., Boris, B.: Management dashboard in a retail scenario. In: Kahl, G., Schwartz, T., Nurmi, P., Dim, E., Forsblom, A. (eds.) Workshop on Location Awareness in Dual and Mixed Reality, pp. 22–25. Online-Proceedings (2011)Google Scholar
  13. 13.
    Kleiner, E., SchAd’fer, B.: Augmented shelf: digital enrichment of library shelves. In: M ~ Aijnchen. Oldenbourg Verlag, pp. 541–544 (2012)Google Scholar
  14. 14.
    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 1997. ACM, pp. 234–241 (1997)Google Scholar
  15. 15.
    Rekimoto, J., Ayatsuka, Y., Hayashi, K.: Augment-able reality: situated communication through physical and digital spaces. In: Second International Symposium on Wearable Computers. Digest of Papers, pp. 68–75 (1998)Google Scholar
  16. 16.
    Faria, S., Assunçao, J., Carvalho, V., Silva A., Ferreira, P., Reinares, E.: Consumer behavior in retail: online and offline – what is the future? In: International Conference on Marketing and Consumer Behavior, ICMC 2013 (2013)Google Scholar
  17. 17.
  18. 18.
    Zhang, B., Chen Y., Tuna C., Dave, A., Y. Li, Lee E., Hartmann, B.: HOBS: head orientation-based selection in physical spaces. In: ACM Symposium on Spatial User Interaction, SUI 2014 (2014)Google Scholar
  19. 19.
    Rashid, Z., Pous, R., Melià-Seguí, J., Morenza, M.: Cricking: browsing physical spaces with smart glass. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, UbiComp 2014 Adjunct. ACM, New York, pp. 155–158 (2014)Google Scholar
  20. 20.
    Keonn Technologies International.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Zulqarnain Rashid
    • 1
  • Joan Melià-Seguí
    • 2
  • Rafael Pous
    • 1
  1. 1.Department of Information and Communication TechnologiesUniversitat Pompeu FabraBarcelonaSpain
  2. 2.Estudis d’Informàtica, Multimèdia i Telecomunicació Internet Interdisciplinary Institute (IN3)Universitat Oberta de CatalunyaBarcelonaSpain

Personalised recommendations