Skip to main content
SpringerLink
Log in

Usability of one-handed interaction methods for handheld projection-based augmented reality

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

With the advent of the portable projector (also embeddable in a smart phone), projection-based augmented reality (AR) will be an attractive form of AR as the augmentation is made directly in the real space (instead of on the video screen). Several interaction methods for such “Procam”-based projection AR systems have been developed, but their comparative usability has not been studied in depth. In this paper, we compared the usability of four representative interaction methods, as applied to the menu selection task, for the handheld projection-based AR. In particular, we explored the possibility of using just one hand for enhanced convenience and mobility. As such, the four menu selection methods chosen for the study were formed by combinations of two types of cursor control (projector cursor vs. on-device touch screen), and two types of object selection (explicit click vs. crossing), all feasible with only one hand. Other considerations included the need for maintaining the stability of the handheld projector and effectively taking advantage of the smart phone as the interaction device. Experimental results have shown that the menu selection task was the most efficient, usable and preferred when the projector cursor with the crossing widget was used. Furthermore, the task performance was not statistically different among using the dominant, non-dominant hand and even both hands.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Samsung Pico Projector SP-H03.

References

  1. Ballagas R, Rohs M, Sheridan JG (2005) Sweep, point and shoot: phonecam-based interactions for large public displays. In: Conference on human factors in computing systems, pp 1200–1203

  2. Beardsley P, Baar J, Raskar R, Forlines C (2005) Interaction using a handheld projector. IEEE Comput Graph Appl 25(1):39–43

    Article  Google Scholar 

  3. Cao X (2009) Handheld projector interaction, PhD thesis, University of Toronto

  4. Fitzmaurice G (1993) Situated information spaces and spatially aware palmtop computers. Commun ACM 36(7):38–49

    Article  Google Scholar 

  5. Fitzmaurice G, Zhai S, Chignell MH (1993) Virtual reality for palmtop computers. ACM Transact Infor Syst 11(3):197–218

    Article  Google Scholar 

  6. Forlines C, Balakrishnan R, Beardsley P, Baar JJ, Raskar R (2005) Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. In: proceedings of the 18th annual ACM symposium on user interface software and technology. ACM Press, Seattle, WA, USA, pp 73–82

  7. Hachet M, Pouderoux J, Guitton P (2005) A camera-based interface for interaction with mobile handheld computers. In: proceedings of the symposium on interactive 3D graphics and games, pp 65–72

  8. Hachet M, Kitamura Y (2005) 3D Interaction with and from handheld computers. In: proceedings of the IEEE VR 2005 workshop: new directions in 3D user interfaces, pp 11–14

  9. Hansen T, Eriksson E, Lykke-Olesen A (2005) Mixed interaction space: designing for camera based interaction with mobile devices. In: proceedings of ACM CHI 2005 conference on human factors in computing systems, pp 1933–1936

  10. Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: proceedings of the 2nd international workshop on augmented reality, pp 85–94

  11. Kukimoto N, Furusho Y, Nonaka J, Koyamada K, Kanazawa M (2003) PDA-based visualization control and annotation interface for virtual environment. In: proceeding of 3rd IASTED international conference visualization, image and image processing

  12. Mantyla V, Mantyjarvi J, Seppanen T, Tuulari E (2000) Hand gesture recognition of a mobile device user. In: proceedings of the IEEE international conference on multi-media and expo, pp 281–284

  13. Paelke V, Reimann C, Stichling D (2004) Foot-based mobile interaction with games. In: ACM SIGCHI international conference on advances in computer entertainment technology (ACE), pp 321–324

  14. Pinhanez C (2001) The everywhere displays projector: a device to create ubiquitous graphical interfaces. Conference on ubiquitous computing, pp 315–331

  15. Rapp S, Michelitsch G, Osen M, Williams J, Barbisch M, Bohan R, Valsan Z, Emele M (2004) Spotlight navigation: interaction with a handheld projection device. International conference on pervasive computing, Video paper

  16. Rohs M, Zweifel P (2005) A conceptual framework for camera phone-based interaction techniques. Lect Notes Comput Sci 3468:171–189

    Article  Google Scholar 

  17. Sugimoto M, Miyahara K, Inoue H, Tsunesada Y (2005) Hotaru: intuitive manipulation techniques for projected displays of mobile devices. Proceeding of INTERACT, LNCS 3585, pp 57–68

  18. Wagner D, Schmalstieg D (2003) First steps towards handheld augmented reality. In: proceedings of the 7th international conference on wearable computers, p 127

  19. Watsen K, Darken RP, Capps M (1999) A handheld computer as an interaction device to a virtual environment. In: proceedings of the third immersive projection technology workshop

  20. Willis K, Poupyrev I, Shiratori T (2011) MotionBeam: a metaphor for character interaction with handheld projectors. Proceedings of ACM SIGCHI

  21. Winograd T, Guimbretière F (1999) Visual instruments for an interactive mural. Proceedings of ACM SIGCHI, Extended Abstracts, pp 234–235

  22. Yoshida T, Hirobe Y, Nii H, Kawakami N, Tachi S (2010) Twinkle: interacting with physical surfaces using handheld projector. Proceedings of IEEE virtual reality conference

  23. ARToolKit (2011) http://artoolkit.sourceforge.net/. Accessed 28 Dec 2011

Download references

Acknowledgments

This research was supported by the MKE/KIAT (Strategic Technology Laboratory Support Program) and the Korea Science Foundation (Research Grant NRF-2010-32A B00183 and the ERC Program in Holo-Digilog Human Media).

Author information

Authors and Affiliations

  1. Digital Experience Laboratory, College of Information and Communications, Korea University, Seoul, Korea

    Jinhyuk Choi & Gerard J. Kim

Authors
  1. Jinhyuk Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gerard J. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gerard J. Kim.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (AVI 2000 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Choi, J., Kim, G.J. Usability of one-handed interaction methods for handheld projection-based augmented reality. Pers Ubiquit Comput 17, 399–409 (2013). https://doi.org/10.1007/s00779-011-0502-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-011-0502-1

Keywords

Search

Navigation