Sharing Augmented Reality Experience Between HMD and Non-HMD User

  • Shihui XuEmail author
  • Bo Yang
  • Boyang Liu
  • Kelvin Cheng
  • Soh Masuko
  • Jiro Tanaka
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11570)


See-through type augmented reality (AR) head mounted displays (HMDs) allow for a highly immersive experience and are currently becoming widely used in e-commerce domains. Current AR systems mainly focus on improving the experience for the user who is wearing the HMD (HMD user), resulting in the exclusion of bystander without HMD (non-HMD user) from AR experience. We propose sharing the AR experience between the HMD user and non-HMD user by visualizing and synchronizing the virtual objects to a smartphone, thereby enabling non-HMD user to see and interact with the virtual objects on their smartphones directly. We also proposed a pre-experience system which provides users with a mobile AR based virtual product experience for enhancing online shopping. We share the experience between HMD user and non-HMD user to illustrate the concept of our approach, where the HMD user can interact with a virtual product when shopping online to get a better sense of the real product, and where the non-HMD user can have a similar AR experience through smartphones.


Augmented reality Sharing Head mounted display 


  1. 1.
    Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Found. Trends Hum.-Comput. Interact. 8(2–3), 73–272 (2015)CrossRefGoogle Scholar
  2. 2.
    Benko, H., Ishak, E., Feiner, S.: Collaborative mixed reality visualization of an archaeological excavation. In: 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 132–140. IEEE, Arlington (2004)Google Scholar
  3. 3.
    Gugenheimer, J., Stemasov, E., Frommel, J., Rukzio, E.: ShareVR: enabling co-located experiences for virtual reality between HMD and non-HMD users. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4021–4033. ACM, Denver (2017)Google Scholar
  4. 4.
    Stafford, A., Piekarski, W., Thomas, B.: Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 165–172. IEEE, Washington (2006)Google Scholar
  5. 5.
    Rekimoto, J.: Transvision: a hand-held augmented reality system for collaborative design. In: Proceedings of Virtual Systems and Multi-Media, pp. 18–20. IEEE, Gifu (1996)Google Scholar
  6. 6.
    Gugenheimer, J., Stemasov, E., Sareen, H., Rukzio, E.: FaceDisplay: towards asymmetric multi-user interaction for nomadic virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, no. 54. ACM, Montreal (2018)Google Scholar
  7. 7.
    Kiyokawa, K., Billinghurst, M., Hayes, S., Gupta, A., Sannohe, Y., Kato, H.: Communication behaviors of co-located users in collaborative AR interfaces. In: International Symposium on Mixed and Augmented Reality, pp. 139–148. ACM, Darmstadt (2002)Google Scholar
  8. 8.
    Lindley, S., Couteur, J., Berthouze, N.: Stirring up experience through movement in game play: effects on engagement and social behaviour. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 511–514. ACM, Florence (2008)Google Scholar
  9. 9.
  10. 10.
  11. 11.
    Microsoft HoloLens. Accessed 25 Jan 2019
  12. 12.
  13. 13.
  14. 14.
  15. 15.
    Developing Vuforia Engine Apps for HoloLens. Accessed 25 Jan 2019
  16. 16.
  17. 17.
  18. 18.
    Billinghurst, M., Kato, H.: Collaborative augmented reality. Commun. ACM 45(7), 64–70 (2002)CrossRefGoogle Scholar
  19. 19.
  20. 20.
    Field of view. Accessed 25 Jan 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Shihui Xu
    • 1
    Email author
  • Bo Yang
    • 1
  • Boyang Liu
    • 1
  • Kelvin Cheng
    • 2
  • Soh Masuko
    • 2
  • Jiro Tanaka
    • 1
  1. 1.Waseda UniversityFukuokaJapan
  2. 2.Rakuten Institute of TechnologyRakuten, Inc.TokyoJapan

Personalised recommendations