A Directional Stroke Recognition Technique for Mobile Interaction in a Pervasive Computing World
This paper presents a common gestural interface to mobile and pervasive computing devices. We report our development of a novel technique for recognizing input strokes on a range of mobile and pervasive devices, ranging from small devices with low processing capabilities and limited input area to computers with wall-sized displays and an input area as large as can be accommodated by motion-sensing technologies such as cameras. Recent work has included implementing and testing our stroke recognition technique and associated object-tracking by camera. Ongoing and future work includes optimizing our stroke recognition and camera-based object-tracking techniques, developing input based on human body tracking and running extended usability evaluations.
Keywordsstroke recognition gestural interfaces pervasive computing ubiquitous computing mobile interaction
Unable to display preview. Download preview PDF.
- Brewster, S. A., Lumsden, J., Bell, M., Hall, M. & Tasker, S. , Multi-modal “Eyes Free” Interaction Techniques for Wearable Devices, in G. Cockton & P. Korhonen (eds.), Proceedings of CHI’03 Conference on Human Factors in Computing Systems, CHI Letters 5(1), ACM Press, pp.473–80.CrossRefGoogle Scholar
- Callahan, J., Hopkins, D., Weiser, M. & Shneiderman, B. , An Empirical Comparison of Pie vs. Linear Menus, in M. E. Atwood, C.-M. Karat, A. Lund, J. Coutaz & J. Karat (eds.), Proceedings of the CHI’98 Conference on Human Factors in Computing Systems, ACM Press, pp.95-100.Google Scholar
- Guimbretiere, F., Stone, M. & Winograd, T. , Fluid Interaction with High-resolution Wall-size Displays, in J. Marks & E. Mynatt (eds.), Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, U1ST2001, CHI Letters 3(2), ACM Press, pp.21–30.CrossRefGoogle Scholar
- Igarashi, T., Edwards, W. K., LaMarca, A. & Mynatt, E. D. , An Architecture for Pen-based Interaction on Electronic Whiteboards, in S. Levialdi, V. di Gesu & L. Tarantino (eds.), Proceedings of the Working Conference on Advanced Visual Interfaces, ACM Press, pp.68–75.Google Scholar
- Pirhonen, A., Brewster, S. & Holguin, C. , Gestural and Audio Metaphors as a Means of Control for Mobile Devices, in D. Wixon (ed.), Proceedings of CHI’02 Conference on Human Factors in Computing Systems: Changing our World, Changing Ourselves, CHI Letters 4(1), ACM Press, pp.291–8.CrossRefGoogle Scholar
- Rubine, D. , Specifying Gestures by Example, in J. J. Thomas (ed.), Proceedings of the Conference on Computer Graphics and Interactive Techniques, ACM Press, pp.329-37.Google Scholar
- Sutherland, I. , Sketchpad: A Man-Machine Graphical Communication System, in Proceedings of the Spring Joint Computer Conference, IFIP, pp.329-46.Google Scholar
- Zhao, R. , Incremental Recognition in Gesture-based and Syntax-directed Diagram Editors, in S. Ashlund, K. Mullet, A. Henderson, E. Hollnagel & T. White (eds.), Proceedings of INTERCHI’93, ACM Press/IOS Press, pp.95-100.Google Scholar