Skip to main content
SpringerLink
Log in

The Effect of View Independence in a Collaborative AR System

  • Published:
Computer Supported Cooperative Work (CSCW) Aims and scope Submit manuscript

Abstract

In this paper we describe a system for remote collaboration using Augmented Reality (AR) that supports view independence. The system was designed to allow a remote user to assist a local user in an object placement task. The remote helper can navigate the local user’s scene independently from the local user by using a three-dimensional reconstruction of the environment. The remote user can also place virtual annotations in the scene that the local user views through a head mounted display. The system tracks the position of key physical objects and the local user’s head pose, displaying both to the remote user. A key advantage of this system compared to other collaborative AR interfaces is that it allows the remote expert to have an independent view into the shared task space. A user study was performed using this system with the users completing a simple mostly two-dimensional object placement task. It was designed to test how the amount of remote view independence affected collaboration. Four conditions were used with varying degrees of view independence. It was found that increased view independence led to faster task completion time, more confidence from users, and a decrease in the amount of time spent communicating verbally during the task. However, varying the view independence did not significantly change the accuracy of the placement of objects. The implications of the results are discussed along with directions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17

Similar content being viewed by others

References

  • Advanced Realtime Tracking GmbH (n.d.). DTrack2. Retrieved July 4, 2015, from http://www.ar-tracking.com/products/software/dtrack2/

  • Benko, Hrvoje, Ricardo Jota, and Andrew Wilson (2012). MirageTable: freehand interaction on a projected augmented reality tabletop. CHI’12: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 199–208

  • Biocca, Frank, Chad Harms, and Judee K. Burgoon (2003). Toward a more robust theory and measure of social presence. Presence: Teleoperators and Virtual Environments, vol. 12, no. 5, pp. 456–480

  • Brooke, John (1996). SUS-A quick and dirty usability scale. Usability Evaluation in Industry, vol. 189, pp. 194

  • Cheng, Le-Te, and John Robinson (1998). Dealing with speed and robustness issues for video-based registration on a wearable computing platform. Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215). Washington, DC: IEEE Computer Society, p. 84

  • Durrant-Whyte, Hugh, and Tim Bailey (2006). Simultaneous Localization and Mapping (SLAM): part I: The Essential Algorithms. Robotics & Automation Magazine, vol. 2, pp. 99–110

  • Fussell, Susan R., Leslie D. Setlock, and Robert E. Kraut (2003). Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. CHI’03: Proceedings of the Conference on Human factors in computing systems. New York, New York: ACM, pp. 513–520

  • Fussell, Susan, Leslie Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam Kramer (2004). Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks. Human-Computer Interaction, vol. 19, pp. 273–309

  • Gauglitz, Steffen, Cha Lee, Matthew Turk, and Tobias Höllerer (2012). Integrating the physical environment into mobile remote collaboration. MobileHCI’12: Proceedings of the 14th International Conference on Human-computer interaction with Mobile Devices and Services. New York, New York: ACM, p. 241

  • Gauglitz, Steffen, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer (2014a). In touch with the remote world. VRST’14: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology. New York, New York: ACM, pp. 197–205

  • Gauglitz, Steffen, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer (2014b). World-stabilized annotations and virtual scene navigation for remote collaboration. UIST’14: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 449–459

  • Gaver, William W., Abigail Sellen, Christian Heath, and Paul Luff (1993). One is not enough: multiple views in a media space. Proceedings of the INTERCHI’93: Conference on Human factors in Computing Systems. Amsterdam, The Netherlands: IOS Press, pp. 335–341

  • Gelb, Dan, Anbumani Subramanian, and Kar Han Tan (2011). Augmented reality for immersive remote collaboration. POV 2011: 2011 I.E. Workshop on Person-Oriented Vision. IEEE, pp. 1–6

  • Haller, Michael, Mark Billinghurst, Daniel Leithinger, Jakob Leitner, and Thomas Seifried (2005). Coeno: enhancing face-to-face collaboration. ICAT’05: Proceedings of the 2005 International Conference on Augmented Tele-existence. New York, New York: ACM, p. 40

  • Henry, Peter, Michael Krainin, Evan Herbst, Xiaofeng Ren, and Dieter Fox (2012). RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research, vol. 31, pp. 647–663

  • Hills, Aimèe, Jörg Hauber, and Holger Regenbrecht (2005). Videos in Space: A study on Presence in Video Mediating Communication Systems. Proceedings of the 2005 International Conference on Augmented Tele-existence. New York, New York: ACM, pp. 2–3

  • Izadi, Shahram, Ankur Agarwal, Antonio Criminisi, John Winn, Andrew Blake, and Andrew Fitzgibbon (2007). C-Slate: A multi-touch and object recognition system for remote collaboration using horizontal surfaces. Tabletop 2007: 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems. Washington, DC: IEEE, pp. 3–10

  • Izadi, Sharam, Kimm David, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, … Andrew Fitzgibbon (2011). KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. Proceedings of User Interface Software and Technology Symposium 2011. New York, New York: ACM, pp. 559–568

  • Kim, Kibum, John Bolton, Audrey Girouard, Jeremy Cooperstock, and Roel Vertegaal (2012). TeleHuman: Effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod. CHI’12: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 2531–2540

  • Kirk, David, Tom Rodden, and Stanton Danaë Fraser (2007). Turn It This Way: Grounding Collaborative Action with Remote Gestures. CHI’07: Proceedings of the 25th annual ACM conference on Human factors in Computing Systems. New York, New York: ACM, pp. 1039–1048

  • Klein, Georg, and David Murray (2007). Parallel tracking and mapping for small AR workspaces. ISMAR 07: 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Washington, DC: IEEE Computer Society

  • Kraut, Robert E., Mark D. Miller, and Jane Siegel (1996). Collaboration in performance of physical tasks. CSCW’96: Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 57–66

  • Kraut, Robert, Susan Fussell, and Jane Siegel (2003). Visual Information as a Conversational Resource in Collaborative Physical Tasks. Human-Computer Interaction, vol. 18, no. 1, pp. 13–49

  • Kurata, Takeshi, Nobuchika Sakata, Masakatsu Kourogi, Hideaki Kuzuoka, and Mark Billinghurst (2004). Remote collaboration using a shoulder-worn active camera/laser. Eighth International Symposium on Wearable Computers. Washington, DC: IEEE Computer Society

  • Kuzuoka, Hideaki, Toshio Kosuge, and Masatomo Tanaka (1994). GestureCam: A video communication system for sympathetic remote collaboration. Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 35–43

  • Kuzuoka, Hideaki, Shinya Oyama, Keiichi Yamazaki, Kenji Suzuki, and Mamoru Mitsuishi (2000). GestureMan: a mobile robot that embodies a remote instructor’s actions. Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work. New York, New York: ACM, pp. 155–162

  • Lukosch, Stephan, Ronald Poelman, Oytun Akman, and Pieter Jonker (2012). A Novel Gesture-based Interface for Crime Scene Investigation in Mediated Reality. Proceedings of the CSCW Work-shop on Exploring Collaboration in Challenging Environments. New York, New York: ACM, pp. 3–6

  • Newcombe, Richard A., Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J. Davison, … Andrew Fitzgibbon (2011). KinectFusion: Real-time dense surface mapping and tracking. ISMAR’11: 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Washington, DC: IEEE Computer Society, pp. 127–136

  • OpenSceneGraph (n.d.). OpenSceneGraph. Retrieved July 4, 2015, from http://www.openscenegraph.org/

  • Ou, Jiazhi, Xilin Chen, Susan R. Fussell, and Jie Yang (2003). DOVE : Drawing over Video Environment. Proceedings of the Eleventh ACM International Conference on Multimedia. New York, New York: ACM, pp. 100–101

  • Park, Kyoung S., Abhinav Kapoor, and Jason Leigh (2000). Lessons learned from employing multiple perspectives in a collaborative virtual environment for visualizing scientific data. CVE’00: Proceedings of the Third International Conference on Collaborative Virtual Environments, pp. 73–82

  • Poelman, Ronald, and Oytun Akman (2012). As if being there: mediated reality for crime scene investigation. Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work. New York, New York: ACM

  • Rekimoto, Jun, and M. Saitoh (1999). Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: The CHI is the Limit. New York, New York: ACM, pp. 378–385

  • Rusu, Radu Bogdan, and Steve Cousins (2011). 3D is here: Point Cloud Library (PCL). Proceedings - IEEE International Conference on Robotics and Automation. Washington, DC: IEEE Computer Society

  • Sakata, Nobuchika, Takeshi Kurata, and Hideaki Kuzuoka (2006). Visual assist with a laser pointer and wearable display for remote collaboration. Proc. 2nd International Conference on Collaboration Technologies. New York, New York: ACM

  • Sodhi, Rajinder S., Brett R. Jones, David Forsyth, Brian P. Bailey, and Giuliano Maciocci (2013). BeThere: 3D Mobile Collaboration with Spatial Input. CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, New York: ACM, pp. 179–188

  • Sousa Santos, Beatriz, Paulo Dias, Angela Pimentel, Jan Willem Baggerman, Carlos Ferreira, Samuel Silva, and Joaquim Madeira (2009). Head-mounted display versus desktop for 3D navigation in virtual reality: A user study. Multimedia Tools and Applications, vol. 41, no. 1, pp. 161–181

  • wxWidgets (n.d.). wxWidgets: Cross-Platform GUI Library. Retrieved July 4, 2015, from http://wxwidgets.org/

  • Zhou, Feng, Henry Been Lirn Dun, and Mark Billinghurst (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. ISMAR’08: Proceedings - 7th IEEE International Symposium on Mixed and Augmented Reality 2008. Washington, DC: IEEE Computer Society, pp. 193–202

  • zSpace Inc (n.d.). zSpace Product. Retrieved 4 July 2015, from http://zspace.com/product

Download references

Author information

Authors and Affiliations

  1. Human Interface Technology Laboratory New Zealand, University of Canterbury, Christchurch, New Zealand

    Matthew Tait & Mark Billinghurst

Authors
  1. Matthew Tait
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Billinghurst
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthew Tait.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tait, M., Billinghurst, M. The Effect of View Independence in a Collaborative AR System. Comput Supported Coop Work 24, 563–589 (2015). https://doi.org/10.1007/s10606-015-9231-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10606-015-9231-8

Keywords

Search

Navigation