A Method to Extend Functionality of Pointer Input Devices

  • Oleg Gusyatin
  • Mikhail Urinson
  • Margrit Betke
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3196)


We describe a general method for extending any pointer input device with an arbitrary set of commands. The proposed interface can be trained by the user to recognize certain cursor movement patterns and interpret them as special input events. Methods for extraction and recognition of such patterns are general enough to work with low-precision pointing devices, and they can be adjusted to provide computer access for people with disabilities. The core of the system is a trainable classifier, in the current implementation an artificial neural network. The architecture of the neural network automatically adjusts according to complexity of the classification task. The system demonstrated good accuracy and responsiveness during extensive experiments. Some tests included a severely motion-impaired individual.


Artificial Neural Network Hide Node Input Device Interarrival Time Pointer Input 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Betke, M., Gips, J., Fleming, P.: The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access for People With Severe Disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering 10(1) (2002)Google Scholar
  2. 2.
    Cloud, R.L., Betke, M., Gips, J.: Experiments with a Camera-Based Human-Computer Interface System. In: Proceedings of the 7th ERCIM Workshop User Interfaces for All UI4ALL, 2002, Paris, France, October 2002, pp. 103–110 (2002)Google Scholar
  3. 3.
    Cun, Y.L., Bottou, L., Orr, G., Muller, K.: Efficient BackProp. In: Orr, G.B., Müller, K.-R. (eds.) NIPS-WS 1996. LNCS, vol. 1524, pp. 5–50. Springer, Heidelberg (1998)Google Scholar
  4. 4.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley Interscience, New York (2001)zbMATHGoogle Scholar
  5. 5.
    Fahlman, S.E., Lebiere, C.: The Cascade-Correlation learning architecture. Technical Report CMU-CS-90-100, School of Computer Science, Carnegie Mellon University, Pittsburg PA (1991) Google Scholar
  6. 6.
    Grauman, K., Betke, J., Lombardi, J., Gips, J., Bradski, G.: Communication via Eye Blinks and Eyebrow Raises: Video-Based Human-Computer Interfaces. Universal Access in the Information Society 2(4), 359–373 (2003)CrossRefGoogle Scholar
  7. 7.
    Hecht-Nielsen, R.: Kolmogorov’s Mapping Neural Network Existence Theorem. In: Proceedings of IEEE First Annual Int. Conf. on Neural Networks, San Diego, vol. 3, pp. 11–13 (1987)Google Scholar
  8. 8.
    Iyer, M.S., Rhinehart, R.R.: A Method to Determine the Required Number of Neural Network Training Repetitions. In: Proceedings of IEEE Transactions on Neural Networks, vol. 10(2), pp. 427–432 (1999)Google Scholar
  9. 9.
    Kim, K.-N., Ramakrishna, R.S.: Vision-Based Eye-Gaze Tracking for Human Interface. In: IEEE International Conf. on Systems, Man, and Cybernetics, Tokyo, Japan (1999)Google Scholar
  10. 10.
    Sjogaard, S.: A Conceptual Approach to Generalization in Dynamic Neural Networks. Ph.D. Thesis, Aarhus University, Aarhus, Denmark (1991) Google Scholar
  11. 11.
    Widrow, B., Lehr, M.A.: 30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation. Proceedings of the IEEE 78(9), 1415–1442 (1990)CrossRefGoogle Scholar
  12. 12.
    Yeung, D.-Y.: Node Splitting: A Constructive Algorithm for Feed-Forward Neural Networks. In: Moody, J.E., Hanson, S.J., Lippman, R.P. (eds.) Advances in Neural Information Processing Systems, San Mateo, CA, vol. 4, pp. 1072–1079. Morgan Kaufman Publishers, San Francisco (1991)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Oleg Gusyatin
    • 1
    • 2
  • Mikhail Urinson
    • 3
  • Margrit Betke
    • 1
  1. 1.Department of Computer ScienceBoston UniversityBostonUSA
  2. 2.Department of Cognitive and Neural SystemsBoston UniversityBostonUSA
  3. 3.Department of Computer ScienceTufts UniversityMedfordUSA

Personalised recommendations