A Directional Stroke Recognition Technique for Mobile Interaction in a Pervasive Computing World

  • Vassilis Kostakos
  • Eamonn O’Neill

Abstract

This paper presents a common gestural interface to mobile and pervasive computing devices. We report our development of a novel technique for recognizing input strokes on a range of mobile and pervasive devices, ranging from small devices with low processing capabilities and limited input area to computers with wall-sized displays and an input area as large as can be accommodated by motion-sensing technologies such as cameras. Recent work has included implementing and testing our stroke recognition technique and associated object-tracking by camera. Ongoing and future work includes optimizing our stroke recognition and camera-based object-tracking techniques, developing input based on human body tracking and running extended usability evaluations.

Keywords

stroke recognition gestural interfaces pervasive computing ubiquitous computing mobile interaction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brewster, S. A. [2002], Overcoming the Lack of Screen Space on Mobile Computers, Personal and Ubiquitous Computing 6(3), 188–205.CrossRefGoogle Scholar
  2. Brewster, S. A., Lumsden, J., Bell, M., Hall, M. & Tasker, S. [2003], Multi-modal “Eyes Free” Interaction Techniques for Wearable Devices, in G. Cockton & P. Korhonen (eds.), Proceedings of CHI’03 Conference on Human Factors in Computing Systems, CHI Letters 5(1), ACM Press, pp.473–80.CrossRefGoogle Scholar
  3. Callahan, J., Hopkins, D., Weiser, M. & Shneiderman, B. [1998], An Empirical Comparison of Pie vs. Linear Menus, in M. E. Atwood, C.-M. Karat, A. Lund, J. Coutaz & J. Karat (eds.), Proceedings of the CHI’98 Conference on Human Factors in Computing Systems, ACM Press, pp.95-100.Google Scholar
  4. Guimbretiere, F. & Winograd, T. [2000], FlowMenu: Combining Command, Text and Data Entry, in M. Ackerman & K. Edwards (eds.), Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, UIST2000, CHI Letters 2(2), ACM Press, pp.213–7.CrossRefGoogle Scholar
  5. Guimbretiere, F., Stone, M. & Winograd, T. [2001], Fluid Interaction with High-resolution Wall-size Displays, in J. Marks & E. Mynatt (eds.), Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, U1ST2001, CHI Letters 3(2), ACM Press, pp.21–30.CrossRefGoogle Scholar
  6. Igarashi, T., Edwards, W. K., LaMarca, A. & Mynatt, E. D. [2000], An Architecture for Pen-based Interaction on Electronic Whiteboards, in S. Levialdi, V. di Gesu & L. Tarantino (eds.), Proceedings of the Working Conference on Advanced Visual Interfaces, ACM Press, pp.68–75.Google Scholar
  7. Long, A. C., Landay, J. A., Rowe, L. A. & Michiels, J. [2000], Visual Similarity of Pen Gestures, in T. Turner & G. Szwillus (eds.), Proceedings of the CHI’00 Conference on Human Factors in Computing Systems, CHI Letters 2(1), ACM Press, pp.360–7.CrossRefGoogle Scholar
  8. Pirhonen, A., Brewster, S. & Holguin, C. [2002], Gestural and Audio Metaphors as a Means of Control for Mobile Devices, in D. Wixon (ed.), Proceedings of CHI’02 Conference on Human Factors in Computing Systems: Changing our World, Changing Ourselves, CHI Letters 4(1), ACM Press, pp.291–8.CrossRefGoogle Scholar
  9. Rekimoto, J. [2002], SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces, in D. Wixon (ed.), Proceedings of CHI’02 Conference on Human Factors in Computing Systems: Changing our World, Changing Ourselves, CHI Letters 4(1), ACM Press, pp. 113–20.CrossRefGoogle Scholar
  10. Rubine, D. [1991], Specifying Gestures by Example, in J. J. Thomas (ed.), Proceedings of the Conference on Computer Graphics and Interactive Techniques, ACM Press, pp.329-37.Google Scholar
  11. Sutherland, I. [1963], Sketchpad: A Man-Machine Graphical Communication System, in Proceedings of the Spring Joint Computer Conference, IFIP, pp.329-46.Google Scholar
  12. Zhao, R. [1993], Incremental Recognition in Gesture-based and Syntax-directed Diagram Editors, in S. Ashlund, K. Mullet, A. Henderson, E. Hollnagel & T. White (eds.), Proceedings of INTERCHI’93, ACM Press/IOS Press, pp.95-100.Google Scholar

Copyright information

© Springer-Verlag London 2004

Authors and Affiliations

  • Vassilis Kostakos
    • 1
  • Eamonn O’Neill
    • 1
  1. 1.Department of Computer ScienceUniversity of BathBathUK

Personalised recommendations