Skip to main content

Adaptive Mouse-Replacement Interface Control Functions for Users with Disabilities

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 6766)


We discuss experiences employing a video-based mouse-replacement interface system, the Camera Mouse, at care facilities for individuals with severe motion impairments and propose adaptations of the system. Traditional approaches to assistive technology are often inflexible, requiring users to adapt their limited motions to the requirements of the system. Such systems may have static or difficult-to-change configurations that make it challenging for multiple users to share the same system or for users whose motion abilities slowly degenerate. As users fatigue, they may experience more limited motion ability or additional unintended motions. To address these challenges, we propose adaptive mouse-control functions to be used in our mouse-replacement system. These functions can be changed to adapt the technology to the needs of the user, rather than making the user adapt to the technology. We present observations of an individual with severe cerebral palsy using our system.


  • Adaptive User Interfaces
  • Video-Based Interfaces
  • Camera Mouse


  1. Betke, M., Gips, J., Fleming, P.: The Camera Mouse: Visual tracking of body features to provide computer access for people with severe disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering 10(1), 1–10 (2002)

    CrossRef  Google Scholar 

  2. Boston College Campus School,

  3. The Boston Home,

  4. Camera Mouse – Innovative software for people with disabilities, (accessed August 2010)

  5. Gajos, K.Z., Weld, D.S., Wobbrock, J.O.: Automatically generating personalized user interfaces with Supple. Artificial Intelligence 174, 910–950 (2010)

    CrossRef  Google Scholar 

  6. Kwan, C., Betke, M.: Camera Canvas: Image editing software for people with disabilities. In: International Conference on Human-Computer Interaction, Orlando, Florida, p. 10 (July 2011)

    Google Scholar 

  7. Magee, J., Betke, M.: Hail: hierarchical adaptive interface layout. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010. LNCS, vol. 6179, pp. 139–146. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  8. Magee, J., Wu, Z., Chennamaneni, H., Epstein, S., Theriault, D.H., Betke, M.: Towards a multi-camera mouse-replacement interface. In: 10th International Workshop on Pattern Recognition in Information Systems (PRIS 2010), p. 10 (2010)

    Google Scholar 

  9. Magee, J.J., Epstein, S., Missimer, E., Betke, M.: Adaptive mappings for mouse-replacement interfaces. In: The 12th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2010 (October 2010)

    Google Scholar 

  10. Manresa-Yee, C., Varona, J., Perales, F.J., Negre, F., Muntaner, J.J.: Experiences using a hands-free interface. In: The 10th International ACM Conference on Computers and Accessibility (ASSETS 2008), Halifax, Nova Scotia, Canada, pp. 261–262 (2008)

    Google Scholar 

  11. Paquette, I., Kwan, C., Betke, M.: MenuController: Making Existing Software More Accessible for People with Motor Impairments. Boston University Computer Science Department Technical Report (February 2011)

    Google Scholar 

  12. SmartNav by Natural Point, (accessed August 2010)

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Magee, J.J., Epstein, S., Missimer, E.S., Kwan, C., Betke, M. (2011). Adaptive Mouse-Replacement Interface Control Functions for Users with Disabilities. In: Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Users Diversity. UAHCI 2011. Lecture Notes in Computer Science, vol 6766. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21662-6

  • Online ISBN: 978-3-642-21663-3

  • eBook Packages: Computer ScienceComputer Science (R0)