Skip to main content
SpringerLink
Log in

A Research Overview of Mobile Projected User Interfaces

  • HAUPTBEITRAG
  • MOBILE PROJECTED USER INTERFACES
  • Published:
Informatik-Spektrum Aims and scope

Abstract

In the last few years, the miniaturization of projectors has gained certain momentum. Today, projectors are available that can easily fit into the palm of a hand. Moreover, these devices are even being integrated into mobile phones. Mobile projectors allow users to project digital imagery into physical space virtually anywhere and anytime. The unique characteristics of small-scale projectors open up interesting opportunities for mobile user interface research. This article provides a comprehensive overview of research on mobile projected user interfaces according to three pertinent research directions: (i) nomadic, (ii) handheld, and (iii) tangible projection interfaces. Furthermore, the article outlines future research challenges and indicates trends in neighboring research fields that might foster innovation in the mobile projected user interfaces domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. AAXA Technologies (2013) P2 Jr. Pico Projector. http://www.aaxatech.com/products/p2jr_pico_projector.html, last access: 1. November 2013

  2. AAXA Technologies (2013) P3 Pico Projector. http://www.aaxatech.com/products/p3_pico_projector.htm, last access: 1. November 2013

  3. AAXA Technologies (2013) L1 Laser Pico Projector. http://www.aaxatech.com/products/l1_laser_pico_projector.htm, last access: 1. November 2013

  4. Ballendat T, Marquardt N, Greenberg S (2010) Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 121–130

  5. Cao X, Balakrishnan R (2006) Interacting with dynamically defined information spaces using a handheld projector and a pen. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 225–234

  6. Cao X, Forlines C, Balakrishnan R (2007) Multi-user interaction using handheld projectors. In: Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, pp 43–52

  7. Cauchard JR, Fraser M, Han T, Subramanian S (2012) Steerable projection: exploring alignment in interactive mobile displays. Pers Ubiquitous Comput 16(1):27–37

    Article  Google Scholar 

  8. Cowan LG, Li KA (2011) ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2707–2716

  9. Cowan LG, Weibel N, Griswold WG, Pina LR, Hollan JD (2012) Projector phone use: practices and social implications. Pers Ubiquitous Comput 16(1):53–63

    Article  Google Scholar 

  10. Dachselt R, Häkkilä J, Jones M, Löchtefeld M, Rohs M, Rukzio E (2012) Pico projectors: firefly or bright future? Interactions 19(2):24–29

    Article  Google Scholar 

  11. Dachselt R, Jones M, Häkkilä J, Löchtefeld M, Rohs M, Rukzio E (2011) Mobile and personal projection (MP2). In: CHI ’11 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 21–23

  12. Dachselt R, Sarmad A-S (2011) Interacting with Printed Books Using Digital Pens and Smart Mobile Projection MP2 Workshop at CHI 2011

  13. Global Industry Analysts (2011) Inc. Pico Projectors – A Global Strategic Business Report. http://www.strategyr.com/Pico_Projectors_Market_Report.asp, last access: 1. November 2013

  14. Hang A, Rukzio E, Greaves A (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. ACM, pp 207–216

  15. Hardy J, Alexander J (2012) Toolkit support for interactive projected displays. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 42:1–42:10

  16. Harrison C, Benko H, Wilson AD (2011) OmniTouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 441–450

  17. Harrison C, Ramamurthy S, Hudson SE (2012) On-body interaction: armed and dangerous. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp 69–76

  18. Harrison C, Tan D, Morris D (2010) Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 453–462

  19. Holman D, Vertegaal R, Altosaar M, Troje N, Johns D (2005) Paper windows: interaction techniques for digital paper. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 591–599

  20. Huber J, Liao C, Steimle J, Liu Q (2011) Toward bimanual interactions with mobile projectors on arbitrary surfaces. In: Proc. MP2: Workshop on Mobile and Personal Projection, pp 10–12

  21. Huber J, Steimle J, Liao C, Liu Q, Mühlhäuser M (2012) LightBeam: interacting with augmented real-world objects in pico projections. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, vol. 16. ACM, pp 1–10

  22. Kane SK, Avrahami D, Wobbrock JO et al (2009) Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 129–138

  23. Liao C, Tang H, Liu Q, Chiu P, Chen F (2010) FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface. In: Proceedings of the International Conference on Multimedia. ACM, pp 361–370

  24. Linder N, Maes P (2010) LuminAR: portable robotic augmented reality interface design and prototype Adjunct. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 395–396

  25. Lissermann R, Huber J, Steimle J, Mühlhäuser M (2013) Permulin: collaboration on interactive surfaces with personal in- and output. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 1533–1538

  26. Löchtefeld M, Gehring S, Jung R, Krüger A (2011) Using mobile projection to support guitar learning. In: Dickmann L, Volkmann G, Malaka R, Boll S, Krüger A, Olivier P (eds) Smart graphics. Springer, Berlin Heidelberg, pp 103–114

    Chapter  Google Scholar 

  27. Löchtefeld M, Schöning J, Rohs M, Krüger A (2009) Marauders light: replacing the wand with a mobile camera projector unit. In: Proceedings of the 8th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 19:1–19:4

  28. Microvision (2013) SHOWWX+ Laser Pico Projector. http://www.microvision.com/showwxplus_hdmi/, last access: 1. November 2013

  29. Milgram P, Kishino FA (1994) Taxonomy of mixed reality visual displays. IEICE Trans Inform Syst 77(12):1321–1329

    Google Scholar 

  30. Mistry P, Maes P, Chang L (2009) WUW – wear Ur world: a wearable gestural interface. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4111–4116

  31. Mistry P (2009) ThirdEye: a technique that enables multiple viewers to see different content on a single display screen. In: ACM SIGGRAPH ASIA 2009 Posters. ACM, pp 29:1–29:1

  32. Molyneaux D, Gellersen H, Finney J (2013) Cooperative augmentation of mobile smart objects with projected displays. ACM T Interact Intell Syst 3(2):7:1–7:35

  33. Molyneaux D, Gellersen H, Schiele B (2008) Vision-based detection of mobile smart objects. In: Roggen D, Lombriser C, Tröster G, Kortuem G, Havinga P (eds) Smart sensing and context. Springer, Berlin Heidelberg, pp 27–40

    Chapter  Google Scholar 

  34. Molyneaux D, Gellersen H (2009) Projected interfaces: enabling serendipitous interaction with smart tangible objects. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. ACM, pp 385–392

  35. Molyneaux D, Izadi S, Kim D et al (2012) Interactive environment-aware handheld projectors for pervasive computing spaces. In: Kay J, Lukowicz P, Tokuda H, Olivier P, Krüger A (eds) Pervasive computing. Springer, Berlin Heidelberg, pp 197–215

    Chapter  Google Scholar 

  36. Naimark M (2005) Two unusual projection spaces. Presence-Teleop Virt 14(5):597–605

    Article  Google Scholar 

  37. Rapp S, Michelitsch G, Osen M et al (2004) Spotlight navigation: interaction with a handheld projection device International conference on pervasive computing, video paper.

  38. Raskar R, van Baar J, Beardsley P, Willwacher T, Rao S, Forlines C (2006) iLamps: geometrically aware and self-configuring projectors ACM SIGGRAPH 2006 Courses. In: ACM SIGGRAPH 2006 Papers. ACM

  39. Raskar R, Beardsley P, van Baar J et al (2004) RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. In: ACM SIGGRAPH 2004 Papers. ACM, pp 406–415

  40. Robinson S, Jones M, Vartiainen E, Marsden G (2012) PicoTales: collaborative authoring of animated stories using handheld projectors. In: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, pp 671–680

  41. Rukzio E, Holleis P, Gellersen H (2012) Personal projectors for pervasive computing. IEEE Pervasive Comput 11(2):30–37

    Article  Google Scholar 

  42. Rukzio E, Schöning J, Rohs M, Häkkilä J, Dachselt R (2012) Theme issue on personal projection. Pers Ubiquitous Comput 16(1):1–3

    Article  Google Scholar 

  43. Schöning J, Rohs M, Kratz S, Löchtefeld M, Krüger A (2009) Map torchlight: a mobile augmented reality camera projector unit. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 3841–3846

  44. Sodhi R, Poupyrev I, Glisson M, Israr A (2013) AIREAL: interactive tactile experiences in free air. ACM Trans Graph 32(4):134:1–134:10

  45. Song H, Grossman T, Fitzmaurice G et al (2009) PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 143–152

  46. Song H, Guimbretiere F, Grossman T, Fitzmaurice G (2010) MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2451–2460

  47. Steimle J, Jordt A, Maes P (2013) Flexpad: highly flexible bending interactions for projected handheld displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 237–246

  48. Underkoffler J, Ullmer B, Ishii H (1999) Emancipated pixels: real-world graphics in the luminous room. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing Co., pp 385–392

  49. Weigel M, Boring S, Marquardt N, Steimle J, Greenberg S, Tang A (2013) From focus to context and back: combining mobile projectors and stationary displays. In: Proceedings of GRAND 2013

  50. Weigel M, Boring S, Steimle J, Marquardt N, Greenberg S, Tang A (2013) ProjectorKit: easing rapid prototyping of interactive applications for mobile projectors. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, pp 247–250

  51. Willis KD (2012) A pre-history of handheld projector-based interaction. Pers Ubiquitous Comput 16(1):5–15

    Article  Google Scholar 

  52. Willis KDD, Poupyrev I, Hudson SE, Mahler M (2011) SideBySide: ad-hoc multi-user interaction with handheld projectors. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 431–440

  53. Willis KDD, Poupyrev I, Shiratori T (2011) Motionbeam: a metaphor for character interaction with handheld projectors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 1031–1040

  54. Willis KDD, Shiratori T, Mahler M (2013) HideOut: mobile projector interaction with tangible objects and surfaces. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, pp 331–338

  55. Wilson AD, Benko H (2010) Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 273–282

  56. Wilson ML, Craggs D, Robinson S, Jones M, Brimble K (2012) Pico-ing into the future of mobile projection and contexts. Pers Ubiquitous Comput 16(1):39–52

    Article  Google Scholar 

  57. Winkler C, Pfeuffer K, Rukzio E (2012) Investigating mid-air pointing interaction for projector phones. In: Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 85–94

  58. Winkler C, Reinartz C, Nowacka D, Rukzio E (2011) Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 61–70

  59. Winkler C, Seifert J, Reinartz C, Krahmer P, Rukzio E (2013) Penbook: bringing pen+paper interaction to a tablet device to facilitate paper-based workflows in the hospital domain. In: Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 283–286

  60. Xiao R, Harrison C, Willis KDD, Poupyrev I, Hudson SE (2013) Lumitrack: low cost, high precision, high speed tracking with projected m-sequences. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 3–12

  61. Ye Z, Khalid H (2010) Cobra: flexible displays for mobile gaming scenarios. In: CHI ’10 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4363–4368

  62. Zhao Y, Xue C, Cao X, Shi Y (2011) PicoPet: “Real World” digital pet on a handheld projector. In: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology. ACM, pp 1–2

Download references

Author information

Authors and Affiliations

  1. MIT Media Lab, Cambridge, MA, USA

    Jochen Huber

  2. Singapore University of Technology and Design, Singapore, Singapore

    Jochen Huber

Authors
  1. Jochen Huber
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jochen Huber.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huber, J. A Research Overview of Mobile Projected User Interfaces. Informatik Spektrum 37, 464–473 (2014). https://doi.org/10.1007/s00287-014-0819-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00287-014-0819-z

Keywords

Search

Navigation