Abstract
A significant problem with vision-based user interfaces is that they are typically developed and tuned for one specific configuration — one set of interactions at one location in the world and in image space. This paper describes methods and architecture for a vision system that supports dynamic reconfiguration of interfaces, changing the form and location of the interaction on the fly. We accomplish this by decoupling the functional definition of the interface from the specification of its location in the physical environment and in the camera image. Applications create a user interface by requesting a configuration of predefined widgets. The vision system assembles a tree of image processing components to fulfill the request, using, if necessary, shared computational resources. This interface can be moved to any planar surface in the camera’s field of view. We illustrate the power of such a reconfigurable vision-based interaction system in the context of a prototype application involving projected interactive displays.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wu, Y. and Huang, T., Vision-Based Gesture Recognition: A Review. Lecture Notes in Artificial Intelligence 1739, 1999.
Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG 2002). 2002, IEEE Computer Society: Washington, DC.
Turk, M., ed. Proc. of the Workshop on Perceptual/Perceptive User Interfaces. 2001: Orlando, Florida.
Kjeldsen, F., Visual Recognition of Hand Gesture as a Practical Interface Modality. 1997, Columbia University: New York, New York.
Pinhanez, C.S. and Bobick, A.F., “It/”: A Theater Play Featuring an Autonomous Computer Character. To appear in Presence: Teleoperators and Virtual Environments, 2002.
Pinhanez, C. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. in Proc. of Ubiquitous Computing 2001 (Ubicomp’01). 2001. Atlanta, Georgia.
Zhang, Z., et al. Visual Panel: Virtual Mouse, Keyboard, and 3D Controller with an Ordinary Piece of Paper. in Proc. ACM Perceptual/Perceptive User Interfaces Workshop (PUI’01),. 2001. Florida, USA.
Pingali, G., et al. User-Following Displays. in Proc. of the IEEE International Conference on Multimedia and Expo 2002 (ICME’02). 2002. Lausanne, Switzerland.
Starner, T., et al., Augmented Reality through Wearable Computing. Presence 6(4), 1997: p. 386–398.
Kjeldsen, F. and Hartman, J. Design Issues for Vision-based Computer Interaction Systems. in Proc. of the Workshop on Perceptual User Interfaces. 2001. Orlando, Florida.
Kjeldsen, F., et al. Interacting with Steerable Projected Displays. in Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG’02). 2002. Washington, DC.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kjeldsen, R., Levas, A., Pinhanez, C. (2003). Dynamically Reconfigurable Vision-Based User Interfaces. In: Crowley, J.L., Piater, J.H., Vincze, M., Paletta, L. (eds) Computer Vision Systems. ICVS 2003. Lecture Notes in Computer Science, vol 2626. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36592-3_31
Download citation
DOI: https://doi.org/10.1007/3-540-36592-3_31
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00921-4
Online ISBN: 978-3-540-36592-1
eBook Packages: Springer Book Archive