Personal and Ubiquitous Computing

, Volume 16, Issue 1, pp 27–37 | Cite as

Steerable projection: exploring alignment in interactive mobile displays

  • Jessica R. Cauchard
  • Mike Fraser
  • Teng Han
  • Sriram Subramanian
Original Article


Emerging smartphones and other handheld devices are now being fitted with a set of new embedded technologies such as pico-projection. They are usually designed with the pico-projector embedded in the top of the device. Despite the potential of personal mobile projection to support new forms of interactivity such as augmented reality techniques, these devices have not yet made significant impact on the ways in which mobile data is experienced. We suggest that this ‘traditional’ configuration of fixed pico-projectors within the device is unsuited to many projection tasks because it couples the orientation of the device to the management of the projection space, preventing users from easily and simultaneously using the mobile device and looking at the projection. We present a study which demonstrates this problem and the requirement for steerable projection behaviour and some initial users’ preferences for different projection coupling angles according to context. Our study highlights the importance of flexible interactive projections which can support interaction techniques on the device and on the projection space according to task. This inspires a number of interaction techniques that create different personal and shared interactive display alignments to suit a range of different mobile projection situations.


Personal mobile projection Handheld pico-projectors Interactive steerable displays Hand and feet interaction 



This research was supported by the EPSRC and Mobile VCE through the Core 5 User Interactions programme, grant number EP/G058334/1. The authors would like to thank their colleagues at the Bristol Interaction and Graphics lab for their help and support.


  1. 1.
    Cao X, Forlines C, Balakrishnan R (2007) Multi-user interaction using handheld projectors. Paper presented at the 20th annual ACM symposium on user interface software and technology, Newport, Rhode Island, USAGoogle Scholar
  2. 2.
    Murph D (2010) DigiLife I-One e-reader smuggles along integrated projector, gets white glove treatment at Computex.
  3. 3.
    Wowwee (2010) Cinemin Swivel pico projector.
  4. 4.
    Hang A, Rukzio E, Greaves A (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. Paper presented at the 10th international conference on human computer interaction with mobile devices and services, Amsterdam, The NetherlandsGoogle Scholar
  5. 5.
    Hinckley K, Dixon M, Sarin R, Guimbretiere F, Balakrishnan R (2009) Codex: a dual screen tablet computer. Paper presented at the 27th international conference on human factors in computing systems, Boston, MA, USAGoogle Scholar
  6. 6.
    Light Blue Optics—Light Touch Pico Projector (2010) Accessed 27 Jan 2011
  7. 7.
    Harrison C, Tan D, Morris D (2010) Skinput: appropriating the body as an input surface. In: Proceedings of the CHI ‘10: 28th international conference on human factors in computing systems, Atlanta, Georgia, USA, April 10–15, 2010. ACM, New York, NY, USA, pp 453–462. doi:
  8. 8.
    Mistry P, Maes P (2009) SixthSense: a wearable gestural interface. Paper presented at the ACM SIGGRAPH ASIA 2009 sketches, Yokohama, JapanGoogle Scholar
  9. 9.
    S-Vision mobile projector phone prototype (2010) Accessed 20 Mar 2010
  10. 10.
    Acrossair (2009) Nearest tube iPhone application.
  11. 11.
    Schöning J, Rohs M, Kratz S, Löchtefeld M, Krüger A (2009) Map torchlight: a mobile augmented reality camera projector unit. Paper presented at the 27th international conference extended abstracts on human factors in computing systems, Boston, MA, USAGoogle Scholar
  12. 12.
    Ashdown M, Sato Y (2005) Steerable projector calibration. Paper presented at the IEEE computer society conference on computer vision and pattern recognition (CVPR′05)–workshopsGoogle Scholar
  13. 13.
    Cauchard JR, Fraser M, Sriram S (2010) Offsetting displays on mobile projector phones. Paper presented at the Ubiprojection 2010, Workshop on personal projection at pervasive 2010, Helsinki, Finland, 17 May 2010Google Scholar
  14. 14.
    Pinhanez CS (2001) The everywhere displays projector: a device to create ubiquitous graphical interfaces. Paper presented at the 3rd international conference on ubiquitous computing, Atlanta, Georgia, USAGoogle Scholar
  15. 15.
    Montero CS, Alexander J, Marshall M, Subramanian S Would you do that?—understanding social acceptance of gestural interfaces. In: Proceedings of the MobileHCI 2010, Lisboa, Portugal, 7–10 September 2010Google Scholar
  16. 16.
    McFarlane DC, Wilder SM (2009) Interactive dirt: increasing mobile work performance with a wearable projector-camera system. Paper presented at the 11th international conference on ubiquitous computing, Orlando, Florida, USAGoogle Scholar
  17. 17.
    Wilson AD (2006) Robust computer vision-based detection of pinching for one and two-handed gesture input. Paper presented at the UIST ′06. 19th annual ACM symposium on user interface software and technology, Montreux, SwitzerlandGoogle Scholar
  18. 18.
    Benko H, Wilson A DepthTouch: Using depth-sensing camera to enable freehand interactions on and above the interactive surface. In: Proceedings of the IEEE workshop on tabletops and interactive surfaces '08, Amsterdam, the Netherlands, 1–3 October 2008Google Scholar
  19. 19.
    Manresa C, Varona J, Mas R, Perales F (2005) Hand tracking and gesture recognition for human-computer interaction. Electron Lett Comput Vis Image Anal 5(3):96–104Google Scholar
  20. 20.
    Tsang PWM, Tsang WH (1996) Edge detection on object color. In: Proceedings of the international conference on image processing 1996, 16–19 Sept 1996, pp 1049–1052Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Jessica R. Cauchard
    • 1
  • Mike Fraser
    • 1
  • Teng Han
    • 1
  • Sriram Subramanian
    • 1
  1. 1.Bristol Interaction and GraphicsUniversity of BristolBristolUK

Personalised recommendations