Informatik-Spektrum

, Volume 37, Issue 5, pp 464–473 | Cite as

A Research Overview of Mobile Projected User Interfaces

HAUPTBEITRAG MOBILE PROJECTED USER INTERFACES

Abstract

In the last few years, the miniaturization of projectors has gained certain momentum. Today, projectors are available that can easily fit into the palm of a hand. Moreover, these devices are even being integrated into mobile phones. Mobile projectors allow users to project digital imagery into physical space virtually anywhere and anytime. The unique characteristics of small-scale projectors open up interesting opportunities for mobile user interface research. This article provides a comprehensive overview of research on mobile projected user interfaces according to three pertinent research directions: (i) nomadic, (ii) handheld, and (iii) tangible projection interfaces. Furthermore, the article outlines future research challenges and indicates trends in neighboring research fields that might foster innovation in the mobile projected user interfaces domain.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    AAXA Technologies (2013) P2 Jr. Pico Projector. http://www.aaxatech.com/products/p2jr_pico_projector.html, last access: 1. November 2013Google Scholar
  2. 2.
    AAXA Technologies (2013) P3 Pico Projector. http://www.aaxatech.com/products/p3_pico_projector.htm, last access: 1. November 2013Google Scholar
  3. 3.
    AAXA Technologies (2013) L1 Laser Pico Projector. http://www.aaxatech.com/products/l1_laser_pico_projector.htm, last access: 1. November 2013Google Scholar
  4. 4.
    Ballendat T, Marquardt N, Greenberg S (2010) Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 121–130Google Scholar
  5. 5.
    Cao X, Balakrishnan R (2006) Interacting with dynamically defined information spaces using a handheld projector and a pen. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 225–234Google Scholar
  6. 6.
    Cao X, Forlines C, Balakrishnan R (2007) Multi-user interaction using handheld projectors. In: Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, pp 43–52Google Scholar
  7. 7.
    Cauchard JR, Fraser M, Han T, Subramanian S (2012) Steerable projection: exploring alignment in interactive mobile displays. Pers Ubiquitous Comput 16(1):27–37CrossRefGoogle Scholar
  8. 8.
    Cowan LG, Li KA (2011) ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2707–2716Google Scholar
  9. 9.
    Cowan LG, Weibel N, Griswold WG, Pina LR, Hollan JD (2012) Projector phone use: practices and social implications. Pers Ubiquitous Comput 16(1):53–63CrossRefGoogle Scholar
  10. 10.
    Dachselt R, Häkkilä J, Jones M, Löchtefeld M, Rohs M, Rukzio E (2012) Pico projectors: firefly or bright future? Interactions 19(2):24–29CrossRefGoogle Scholar
  11. 11.
    Dachselt R, Jones M, Häkkilä J, Löchtefeld M, Rohs M, Rukzio E (2011) Mobile and personal projection (MP2). In: CHI ’11 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 21–23Google Scholar
  12. 12.
    Dachselt R, Sarmad A-S (2011) Interacting with Printed Books Using Digital Pens and Smart Mobile Projection MP2 Workshop at CHI 2011Google Scholar
  13. 13.
    Global Industry Analysts (2011) Inc. Pico Projectors – A Global Strategic Business Report. http://www.strategyr.com/Pico_Projectors_Market_Report.asp, last access: 1. November 2013Google Scholar
  14. 14.
    Hang A, Rukzio E, Greaves A (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. ACM, pp 207–216Google Scholar
  15. 15.
    Hardy J, Alexander J (2012) Toolkit support for interactive projected displays. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 42:1–42:10Google Scholar
  16. 16.
    Harrison C, Benko H, Wilson AD (2011) OmniTouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 441–450Google Scholar
  17. 17.
    Harrison C, Ramamurthy S, Hudson SE (2012) On-body interaction: armed and dangerous. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp 69–76Google Scholar
  18. 18.
    Harrison C, Tan D, Morris D (2010) Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 453–462Google Scholar
  19. 19.
    Holman D, Vertegaal R, Altosaar M, Troje N, Johns D (2005) Paper windows: interaction techniques for digital paper. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 591–599Google Scholar
  20. 20.
    Huber J, Liao C, Steimle J, Liu Q (2011) Toward bimanual interactions with mobile projectors on arbitrary surfaces. In: Proc. MP2: Workshop on Mobile and Personal Projection, pp 10–12Google Scholar
  21. 21.
    Huber J, Steimle J, Liao C, Liu Q, Mühlhäuser M (2012) LightBeam: interacting with augmented real-world objects in pico projections. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, vol. 16. ACM, pp 1–10Google Scholar
  22. 22.
    Kane SK, Avrahami D, Wobbrock JO et al (2009) Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 129–138Google Scholar
  23. 23.
    Liao C, Tang H, Liu Q, Chiu P, Chen F (2010) FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface. In: Proceedings of the International Conference on Multimedia. ACM, pp 361–370Google Scholar
  24. 24.
    Linder N, Maes P (2010) LuminAR: portable robotic augmented reality interface design and prototype Adjunct. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 395–396Google Scholar
  25. 25.
    Lissermann R, Huber J, Steimle J, Mühlhäuser M (2013) Permulin: collaboration on interactive surfaces with personal in- and output. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 1533–1538Google Scholar
  26. 26.
    Löchtefeld M, Gehring S, Jung R, Krüger A (2011) Using mobile projection to support guitar learning. In: Dickmann L, Volkmann G, Malaka R, Boll S, Krüger A, Olivier P (eds) Smart graphics. Springer, Berlin Heidelberg, pp 103–114CrossRefGoogle Scholar
  27. 27.
    Löchtefeld M, Schöning J, Rohs M, Krüger A (2009) Marauders light: replacing the wand with a mobile camera projector unit. In: Proceedings of the 8th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 19:1–19:4Google Scholar
  28. 28.
    Microvision (2013) SHOWWX+ Laser Pico Projector. http://www.microvision.com/showwxplus_hdmi/, last access: 1. November 2013Google Scholar
  29. 29.
    Milgram P, Kishino FA (1994) Taxonomy of mixed reality visual displays. IEICE Trans Inform Syst 77(12):1321–1329Google Scholar
  30. 30.
    Mistry P, Maes P, Chang L (2009) WUW – wear Ur world: a wearable gestural interface. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4111–4116Google Scholar
  31. 31.
    Mistry P (2009) ThirdEye: a technique that enables multiple viewers to see different content on a single display screen. In: ACM SIGGRAPH ASIA 2009 Posters. ACM, pp 29:1–29:1Google Scholar
  32. 32.
    Molyneaux D, Gellersen H, Finney J (2013) Cooperative augmentation of mobile smart objects with projected displays. ACM T Interact Intell Syst 3(2):7:1–7:35Google Scholar
  33. 33.
    Molyneaux D, Gellersen H, Schiele B (2008) Vision-based detection of mobile smart objects. In: Roggen D, Lombriser C, Tröster G, Kortuem G, Havinga P (eds) Smart sensing and context. Springer, Berlin Heidelberg, pp 27–40CrossRefGoogle Scholar
  34. 34.
    Molyneaux D, Gellersen H (2009) Projected interfaces: enabling serendipitous interaction with smart tangible objects. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. ACM, pp 385–392Google Scholar
  35. 35.
    Molyneaux D, Izadi S, Kim D et al (2012) Interactive environment-aware handheld projectors for pervasive computing spaces. In: Kay J, Lukowicz P, Tokuda H, Olivier P, Krüger A (eds) Pervasive computing. Springer, Berlin Heidelberg, pp 197–215CrossRefGoogle Scholar
  36. 36.
    Naimark M (2005) Two unusual projection spaces. Presence-Teleop Virt 14(5):597–605CrossRefGoogle Scholar
  37. 37.
    Rapp S, Michelitsch G, Osen M et al (2004) Spotlight navigation: interaction with a handheld projection device International conference on pervasive computing, video paper.Google Scholar
  38. 38.
    Raskar R, van Baar J, Beardsley P, Willwacher T, Rao S, Forlines C (2006) iLamps: geometrically aware and self-configuring projectors ACM SIGGRAPH 2006 Courses. In: ACM SIGGRAPH 2006 Papers. ACMGoogle Scholar
  39. 39.
    Raskar R, Beardsley P, van Baar J et al (2004) RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. In: ACM SIGGRAPH 2004 Papers. ACM, pp 406–415Google Scholar
  40. 40.
    Robinson S, Jones M, Vartiainen E, Marsden G (2012) PicoTales: collaborative authoring of animated stories using handheld projectors. In: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, pp 671–680Google Scholar
  41. 41.
    Rukzio E, Holleis P, Gellersen H (2012) Personal projectors for pervasive computing. IEEE Pervasive Comput 11(2):30–37CrossRefGoogle Scholar
  42. 42.
    Rukzio E, Schöning J, Rohs M, Häkkilä J, Dachselt R (2012) Theme issue on personal projection. Pers Ubiquitous Comput 16(1):1–3CrossRefGoogle Scholar
  43. 43.
    Schöning J, Rohs M, Kratz S, Löchtefeld M, Krüger A (2009) Map torchlight: a mobile augmented reality camera projector unit. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 3841–3846Google Scholar
  44. 44.
    Sodhi R, Poupyrev I, Glisson M, Israr A (2013) AIREAL: interactive tactile experiences in free air. ACM Trans Graph 32(4):134:1–134:10Google Scholar
  45. 45.
    Song H, Grossman T, Fitzmaurice G et al (2009) PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 143–152Google Scholar
  46. 46.
    Song H, Guimbretiere F, Grossman T, Fitzmaurice G (2010) MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2451–2460Google Scholar
  47. 47.
    Steimle J, Jordt A, Maes P (2013) Flexpad: highly flexible bending interactions for projected handheld displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 237–246Google Scholar
  48. 48.
    Underkoffler J, Ullmer B, Ishii H (1999) Emancipated pixels: real-world graphics in the luminous room. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing Co., pp 385–392Google Scholar
  49. 49.
    Weigel M, Boring S, Marquardt N, Steimle J, Greenberg S, Tang A (2013) From focus to context and back: combining mobile projectors and stationary displays. In: Proceedings of GRAND 2013Google Scholar
  50. 50.
    Weigel M, Boring S, Steimle J, Marquardt N, Greenberg S, Tang A (2013) ProjectorKit: easing rapid prototyping of interactive applications for mobile projectors. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, pp 247–250Google Scholar
  51. 51.
    Willis KD (2012) A pre-history of handheld projector-based interaction. Pers Ubiquitous Comput 16(1):5–15CrossRefGoogle Scholar
  52. 52.
    Willis KDD, Poupyrev I, Hudson SE, Mahler M (2011) SideBySide: ad-hoc multi-user interaction with handheld projectors. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 431–440Google Scholar
  53. 53.
    Willis KDD, Poupyrev I, Shiratori T (2011) Motionbeam: a metaphor for character interaction with handheld projectors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 1031–1040Google Scholar
  54. 54.
    Willis KDD, Shiratori T, Mahler M (2013) HideOut: mobile projector interaction with tangible objects and surfaces. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, pp 331–338Google Scholar
  55. 55.
    Wilson AD, Benko H (2010) Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 273–282Google Scholar
  56. 56.
    Wilson ML, Craggs D, Robinson S, Jones M, Brimble K (2012) Pico-ing into the future of mobile projection and contexts. Pers Ubiquitous Comput 16(1):39–52CrossRefGoogle Scholar
  57. 57.
    Winkler C, Pfeuffer K, Rukzio E (2012) Investigating mid-air pointing interaction for projector phones. In: Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 85–94Google Scholar
  58. 58.
    Winkler C, Reinartz C, Nowacka D, Rukzio E (2011) Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 61–70Google Scholar
  59. 59.
    Winkler C, Seifert J, Reinartz C, Krahmer P, Rukzio E (2013) Penbook: bringing pen+paper interaction to a tablet device to facilitate paper-based workflows in the hospital domain. In: Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 283–286Google Scholar
  60. 60.
    Xiao R, Harrison C, Willis KDD, Poupyrev I, Hudson SE (2013) Lumitrack: low cost, high precision, high speed tracking with projected m-sequences. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 3–12Google Scholar
  61. 61.
    Ye Z, Khalid H (2010) Cobra: flexible displays for mobile gaming scenarios. In: CHI ’10 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4363–4368Google Scholar
  62. 62.
    Zhao Y, Xue C, Cao X, Shi Y (2011) PicoPet: “Real World” digital pet on a handheld projector. In: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology. ACM, pp 1–2Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.MIT Media LabCambridgeUSA
  2. 2.Singapore University of Technology and DesignSingaporeSingapore

Personalised recommendations