Mobile Projection Interfaces for Augmented Reality Applications

  • Markus Löchtefeld
  • Antonio Krüger
  • Michael Rohs


Nowadays mobile phones are used for a wide range of applications in peoples every day life. Customizable with a variety of applications these mobile phones are becoming the swiss army knife of the generation. With the increase in processing power and memory the only bottleneck left is the small display size and resolution. To keep these devices mobile the size of the screen is restricted and even though the resolution of such displays is increasing, there is a limit to information presentable on the display. One way to overcome these drawbacks is the integration of a projection unit into the mobile phone. Modern projectors have been miniaturized to the size of mobile phones and can be operated using batteries. These projectors are called pico projectors. The next step is to integrate such a projector directly into a mobile phone. These devices are also called projector phones. Up to now several different prototypes both from research and industry exist. First commercial projector phones are available on the mass market [1]. Such phones have the capabilities to overcome the problems that arise when exploring large-scale information on the small display of a present-day mobile phone. With these devices one can explore information like maps or web pages without the need for zooming or panning [2] but up to now the available devices are only projecting a mirror image of the devices display or images and videos. Considering the anticipated widespread availability of phones with integrated cameras and projectors in the future, comparably little research has been conducted so far to investigate the potential of such a mobile unit.


Mobile Phone Mobile Device Augmented Reality Virtual Object Interaction Technique 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    E. Rukzio and P. Holleis “Projector Phone Interactions: Design Space and Survey,” Proceedings of Workshop on Coupled Display Visual Interfaces at AVI 2010. Rome, Italy, 2010.Google Scholar
  2. 2.
    A. Hang, E. Rukzio, and A. Greaves “Projector phone: a study of using mobile phones with integrated projector for interaction with maps,” Proceedings of the 10th international conference on human computer interaction with mobile devices and services, pages 207–216. ACM 2008.Google Scholar
  3. 3.
    E. Bier, M. Stone, K. Pier, W. Buxton and T. DeRose “Toolglass and magic lenses: the see-through interface,” Proceedings of the 20th annual conference on Computer graphics and interactive techniques, pages 73–80. ACM New York, NY, USA, 1993.Google Scholar
  4. 4.
    R. Raskar, J. van Baar, P. Beardsley, T. Willwacher, S. Rao and C. Forlines “iLamps: geometrically aware and self-configuring projectors,” In ACM SIGGRAPH 2003 Courses, page 5. ACM. 2003.Google Scholar
  5. 5.
    O. Bimber and R. Raskar “Modern approaches to augmented reality,” ACM SIGGRAPH 2007 courses (SIGGRAPH ’07). Article 1, ACM 2007.Google Scholar
  6. 6.
    R. Raskar, P. Beardsley, J. Van Baar, Y. Wang, P. Dietz, J. Lee, D. Leigh and T. Willwacher “RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors,” ACM Transactions on Graphics (TOG), 23(3):406–415, 2004.Google Scholar
  7. 7.
    G. Blasko, S. Feiner and F. Coriand “Exploring Interaction with a Simulated Wrist-Worn Projection Display,” Proceedings of the Ninth IEEE International Symposium on Wearable Computers (ISWC ’05). IEEE Computer Society, Washington, DC, USA, 2–9, 2005.Google Scholar
  8. 8.
    X. Cao, C. Forlines and R. Balakrishnan “Multi-user interaction using handheld projectors,” Proceedings of the 20th annual ACM symposium on User interface software and technology, page 43–52. ACM, 2007.Google Scholar
  9. 9.
    T. Karitsuka and K. Sato, K “A Wearable Mixed Reality with an On-Board Projector,” Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR ’03). IEEE Computer Society, Washington, DC, USA, 321-. 2003.Google Scholar
  10. 10.
    P. Mistry, P. Maes, and L. Chang “WUW-wear Ur world: a wearable gestural interface,” Proceedings of the 27th international conference extended abstracts on human factors in computing systems, pages 4111–4116. ACM, 2010.Google Scholar
  11. 11.
    Z. Ye and H. Khalid “Cobra: flexible displays for mobilegaming scenarios,” Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA ’10). ACM, New York, NY, USA, 4363–4368, 2010.Google Scholar
  12. 12.
    M. Bolas and D. Krum “Augmented Reality Applications and User Interfaces Using Head-Coupled Near-Axis Personal Projectors with Novel Retroreflective Props and Surfaces,” Proceedings of Ubiprojection 2010 1st Workshop on Personal Projection at Pervasive 2010, 2010.Google Scholar
  13. 13.
    I. Sutherland, I. “A head-mounted three dimensional display,” Proceedings of the fall joint computer conference, part I, pages 757–764. ACM, 1968.Google Scholar
  14. 14.
    A. Cheok, S. Fong, K. Goh, X. Yang, W. Liu, F. Farzbiz and Y. Li “Human pacman: A mobile entertainment system with ubiquitous computing and tangible interaction over a wide outdoor area,” Lecture notes in computer science, pages 209–223, 2003.Google Scholar
  15. 15.
    M. Baldauf, P. Fröhlich, and P. Reichl “Gestural interfaces for micro projector-based mobile phone applications,” Adjunct Proceedings of Ubicomp 2009, 2009.Google Scholar
  16. 16.
    J. Cauchard, M. Fraser, J. Alexander and S. Subramanian “Offsetting Displays on Mobile Projector Phones,” Proceedings of Ubiprojection 2010 1st Workshop on Personal Projection at Pervasive 2010, 2010.Google Scholar
  17. 17.
    C. Pinhanez, C. “The everywhere displays projector: A device to create ubiquitous graphical interfaces,” Lecture Notes in Computer Science, pages 315–331, 2001.Google Scholar
  18. 18.
    T. Ballendat, N. Marquardt and S. Greenberg “Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment,” In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces - ACM ITS’2010. (Saarbruecken, Germany), ACM Press, 10 pages, November 7-10, 2010.Google Scholar
  19. 19.
    E. T. Hall “The Hidden Dimension,” Garden City, N.Y.: Doubleday, 1966.Google Scholar
  20. 20.
    M. Rohs, J. Schöning, M. Raubal, G. Essl and A. Krüger “Map navigation with mobile devices: virtual versus physical movement with and without visual context,” Proceedings of the 9th international conference on Multimodal interfaces, pages 146–153. ACM, 2007.Google Scholar
  21. 21.
    M. Rohs, J. Schöning, A. Krüger and B. Hecht “Towards real-time markerless tracking of magic lenses on paper maps,” Adjunct Proceedings of the 5th Intl. Conference on Pervasive Computing (Pervasive), Late Breaking Results, pages 69–72, 2007.Google Scholar
  22. 22.
    D. Modjeska “Navigation in electronic worlds: Research review,” Technical report, Computer Systems Research Group, University of Toronto, 1997.Google Scholar
  23. 23.
    M. Rohs “Real-world interaction with camera phones,” In Ubiquitous Computing Systems, Second International Symposium, UCS 2004, Tokyo, Japan, November 8-9, 2004, Revised Selected Papers, pages 74–89, 2004.Google Scholar
  24. 24.
    A. Wilson “PlayAnywhere: a compact interactive tabletop projection-vision system,” Proceedings of the 18th annual ACM symposium on User interface software and technology, page 83–92. ACM, 2005.Google Scholar
  25. 25.
    R. Davis “Sketch understanding in design: Overview of work at the MIT AI lab,” In Sketch Understanding, Papers from the 2002 AAAI Spring Symposium, pages 24–31, 2002.Google Scholar
  26. 26.
    C. Alvarado and R. Davis “SketchREAD: a multi-domain sketch recognition engine,” Proceedings of the 17th annual ACM symposium on user interface software and technology, pages 23–32. ACM New York, NY, USA, 2004.Google Scholar
  27. 27.
    J. Schöning, M. Rohs, S. Kratz, M. Löchtefeld and A. Krüger “Map torchlight: a mobile augmented reality camera projector unit,” Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 3841–3846. ACM, 2009.Google Scholar
  28. 28.
    M. Löchtefeld, J. Schöning, M. Rohs and A. Krüger “LittleProjectedPlanet: An Augmented Reality Game for Camera Projector Phones,” In Mobile Interaction with the Real World, (MIRW 2009), Mobile HCI Workshop, 2009.Google Scholar
  29. 29.
    M. Löchtefeld, S. Gehring, J. Schöning and A. Krüger “ShelfTorchlight: Augmenting a Shelf using a Camera Projector Unit,” Proceedings of Ubiprojection 2010 1st Workshop on Personal Projection at Pervasive 2010, 2010.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Markus Löchtefeld
    • 1
  • Antonio Krüger
    • 1
  • Michael Rohs
    • 2
  1. 1.German Research Center for Artificial Intelligence DFKIUniversity of SaarlandSaarbrückenGermany
  2. 2.Department of Applied Informatics and Media InformaticsLudwig-Maximilians-University (LMU) MunichMunichGermany

Personalised recommendations