Advertisement

Mobile Camera-Based User Interaction

  • Antonio Haro
  • Koichi Mori
  • Tolga Capin
  • Stephen Wilkinson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3766)

Abstract

We present an approach for facilitating user interaction on mobile devices, focusing on camera-enabled mobile phones. A user interacts with an application by moving their device. An on-board camera is used to capture incoming video and the scrolling direction and magnitude are estimated using a feature-based tracking algorithm. The direction is used as the scroll direction in the application, and the magnitude is used to set the zoom level. The camera is treated as a pointing device and zoom level control in applications. Our approach generates mouse events, so any application that is mouse-driven can make use of this technique.

Keywords

Mobile Device Augmented Reality Tracking Algorithm Camera Motion Template Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Yee, K.P.: Peephole displays: pen interaction on spatially aware handheld computers. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 1–8 (2003)Google Scholar
  2. 2.
    Rohs, M.: Real-world interaction with camera-phones. In: International Symposium on Ubiquitous Computing Systems (2004)Google Scholar
  3. 3.
    Möhring, M., Lessig, C., Bimber, O.: Optical tracking and video see-through ar on consumer cell phones. In: Proceedings of Workshop on Virtual and Augmented Reality of the GI-Fachgruppe AR/VR, pp. 193–204 (2004)Google Scholar
  4. 4.
    Drab, S., Artner, N.: Motion detection as interaction technique for games & applications on mobile devices. In: Extended Abstracts of PERVASIVE: Workshop on Pervasive Mobile Interaction Devices, pp. 48–51 (2005)Google Scholar
  5. 5.
    Beier, D., Billert, R., Bruderlin, B., Stichling, D., Kleinjohann, B.: Marker-less vision based tracking for mobile augmented reality. In: Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 258–259 (2003)Google Scholar
  6. 6.
    Hannuksela, J., Sangi, P., Heikkila, J.: A vision-based approach for controlling user interfaces of mobile devices. In: IEEE Workshop on Vision for Human-Computer Interaction (2005)Google Scholar
  7. 7.
    Igarashi, T., Hinckley, K.: Speed-dependent automatic zooming for browsing large documents. In: Proceedings of the ACM symposium on User interface software and technology (UIST), pp. 139–148 (2000)Google Scholar
  8. 8.
    Cockburn, A., Savage, J., Wallace, A.: Tuning and testing scrolling interfaces that automatically zoom. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 71–80 (2005)Google Scholar
  9. 9.
    Ahlberg, C., Shneiderman, B.: The alphaslider: a compact and rapid selector. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 365–371 (1994)Google Scholar
  10. 10.
    Masui, T., Kashiwagi, K., George, R., Borden, I.: Elastic graphical interfaces to precise data manipulation. In: CHI 1995: Conference companion on Human factors in computing systems, pp. 143–144 (1995)Google Scholar
  11. 11.
    Ayatsuka, Y., Rekimoto, J., Matsuoka, S.: Popup vernier: a tool for sub-pixel-pitch dragging with smooth mode transition. In: Proceedings of the ACM symposium on User interface software and technology (UIST), pp. 39–48 (1998)Google Scholar
  12. 12.
    Siio, I.: Scroll display: Pointing device for palmtop computers. Asia Pacific Computer Human Interaction, 243–248 (1998)Google Scholar
  13. 13.
    Bartlett, J.: Rock ’n’ scroll is here to stay. IEEE Computer Graphics and Applications 20, 40–45 (2000)CrossRefGoogle Scholar
  14. 14.
    Rekimoto, J.: Tilting operations for small screen interfaces. In: Proceedings of the ACM symposium on User interface software and technology (UIST), pp. 167–168 (1996)Google Scholar
  15. 15.
    Davis, J., Bobick, A.: The representation and recognition of human movement using temporal templates. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 928–934 (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Antonio Haro
    • 1
  • Koichi Mori
    • 1
  • Tolga Capin
    • 1
  • Stephen Wilkinson
    • 1
  1. 1.Nokia Research CenterIrvingUSA

Personalised recommendations