A Unified Framework for Remote Collaboration Using Interactive AR Authoring and Hands Tracking

  • Jeongmin Yu
  • Jin-u Jeon
  • Gabyong Park
  • Hyung-il Kim
  • Woontack Woo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9749)


In this paper, we present a unified framework for remote collaboration using interactive augmented reality (AR) authoring and hand tracking methods. The proposed framework enables a local user to organize AR digital contents for making a shared working environment and collaborate multiple users in the distance. To develop the framework, we combine two core technologies: (i) interactive AR authoring method utilizing a smart input device for making a shared working space, (ii) hand-augmented object interaction method by tracking two hands in egocentric camera view. We implement a prototype of the proposed remote collaboration framework for testing its feasibility in an indoor environment. To the end, we expect that our framework enables collaboration as feeling a sense of co-presence with remote users in a user’s friendly AR working space.


Interactive AR authoring Hand-augmented object interaction Remote collaboration system 



This work was supported by National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (NRF-2015M3A6A3073 746, NRF-2014R1A2A2A01003005).


  1. 1.
    Azuma, R.: A survey of augmented reality. Presence 6(4), 355–385 (1997)CrossRefGoogle Scholar
  2. 2.
    Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)CrossRefGoogle Scholar
  3. 3.
    Noh, S., Yeo, H., Woo, W.: An HMD-based mixed reality system for avatar-mediated remote collaboration with bare-hand interaction. In: Eurographics-ICAT-EGVE (2015)Google Scholar
  4. 4.
    Jo, D., Kim, K., Kim, G.: SpaceTime: adaptive control of the teleported avatar for improved AR tele-conference experience. CAVW 26, 259–269 (2015)Google Scholar
  5. 5.
    Ha, T., Billinghurst, M., Woo, W.: An interactive 3D movement path manipulation method in an augmented reality environment. Elsevier Interact. Comput. 24(1), 10–24 (2012)CrossRefGoogle Scholar
  6. 6.
    Ha, T., Feiner, S., Woo, W.: WeARHand: head-worn, RGB-D camera-based, bare-hand user interface with visually enhanced depth perception. In: IEEE ISMAR, pp. 219–228 (2014)Google Scholar
  7. 7.
    Jang, Y., Noh, S., Chang, H., Kim, T., Woo, W.: 3D finger CAPE: clicking action and position estimation under self-occlusions in egocentric viewpoint. IEEE Trans. Vis. Comput. Graph. 21(4), 501–510 (2015)CrossRefGoogle Scholar
  8. 8.
    Wang, Y., Langlotz, T., Billinghurst, M., Bell, T.: An authoring tool for mobile phone AR environments. In: Proceedings of New Zealand Computer Science Research Student Conference, pp. 1–4 (2009)Google Scholar
  9. 9.
    Higuchi, K., Chen, Y., Chou, P., Zhang, Z., Liu Z.: ImmerseBoard: immersive telepresence experience using a digital whiteboard. In: CHI (2015)Google Scholar
  10. 10.
    Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Vis. Comput. Graph. 19(4), 616–625 (2013)CrossRefGoogle Scholar
  11. 11.
    Jung, J., Hong, J., Park, S., Yang, H.: Smartphone as an augmented reality authoring tool via multi-touch based 3D interaction method. In: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, pp. 17–20 (2012)Google Scholar
  12. 12.
    Langlotz, T., Mooslechner, S., Zollmann, S., Degendorfer, C., Reitmayr, G., Schmalstieg, D.: Sketching up the world: in situ authoring for mobile augmented reality. Pers. Ubiquit. Comput. 16(6), 623–630 (2012)CrossRefGoogle Scholar
  13. 13.
  14. 14.
    Fischler, M.A., Robert, C.B.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Klein, G., David, M.: Parallel tracking and mapping for small AR workspaces. In: ISMAR (2007)Google Scholar
  16. 16.
    Oikonomidis, I., Lourakis, M., Argyros, A.: Evolutionary quasi-random search for hand articulations tracking. In: CVPR (2014)Google Scholar
  17. 17.
    Rogez, G., Khademi, M., Supančič III, J.S., Montiel, J.M.M., Ramanan, D.: 3D hand pose detection in egocentric RGB-D images. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014 Workshops. LNCS, vol. 8925, pp. 356–371. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  18. 18.

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Jeongmin Yu
    • 1
  • Jin-u Jeon
    • 1
  • Gabyong Park
    • 1
  • Hyung-il Kim
    • 1
  • Woontack Woo
    • 1
  1. 1.KAIST UVR LabDaejeonSouth Korea

Personalised recommendations