IntellWheels MMI: A Flexible Interface for an Intelligent Wheelchair

  • Luis Paulo Reis
  • Rodrigo A. M. Braga
  • Márcio Sousa
  • Antonio Paulo Moreira
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5949)


With the rising concern about the needs of people with physical disabilities and with the aging of the population there is a major concern of creating electronic devices that may improve the life of the physically handicapped and elderly person. One of these new solutions passes through the adaptation of electric wheelchairs in order to give them environmental perception, more intelligent capabilities and more adequate Human – Machine Interaction. This paper focuses in the development of a user-friendly multimodal interface, which is integrated in the Intellwheels project. This simple multimodal human-robot interface developed allows the connection of several input modules, enabling the wheelchair control through flexible input sequences of distinct types of inputs (voice, facial expressions, head movements, keyboard and, joystick). The system created is capable of storing user defined associations, of input’s sequences and corresponding output commands. The tests performed have proved the system efficiency and the capabilities of this multimodal interface.


Multimodal Interface Intelligent Wheelchair Intelligent Robotics 


  1. 1.
    Oviatt, S.: Multimodal Interfaces. In: Handbook of Human-Computer Interaction, pp. 286–304 (2002)Google Scholar
  2. 2.
    Johnston, M., Bangalore, S., Vasireddy, G.: MATCH: Multimodal Access to City Help. In: IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 256–259 (2001)Google Scholar
  3. 3.
    Cohen, P.R., et al.: QuickSet: Multimodal Interaction for Distributed Applications. In: Proc. 5th ACM Int. Conf. on Multimedia, Seattle, Washington, United States, pp. 31–40 (1997)Google Scholar
  4. 4.
    Keskin, C., Balci, K., Aran, O., Sankur, B., Akarun, L.: A Multimodal 3D Healthcare Communication System. In: 3DTV Conference, May 7-9, pp. 1–4 (2007)Google Scholar
  5. 5.
    Zudilova, E.V., Sloot, P.M.A., Belleman, R.G.: A Multi-modal Interface for an Interactive Simulated Vascular Reconstruction System. In: Proceedings of Fourth IEEE International Conference on Multimodal Interfaces, pp. 313–318 (2002)Google Scholar
  6. 6.
    Braga, R.A.M., Petry, M., Moreira, A.P., Reis, L.P.: Intellwhels - A Development Platform for Intelligent Wheelchairs for Disabled People. In: 5th Int. Conf. on Informatics in Control, Automation and Robotics, Funchal, Madeira, Portugal, vol. I, pp. 115–121 (2008)Google Scholar
  7. 7.
    Martins, B., Valgôde, E., Faria, P., Reis, L.P.: Multimedia Interface with an Intelligent Wheelchair. In: Proc. of CompImage 2006 – Comp. Modelling of Objects Represented in Images: Fundamentals Methods and Applications, Coimbra, Portugal, pp. 267–274 (2006)Google Scholar
  8. 8.
    Faria, P.M., Braga, R.A.M., Valgôde, E., Reis, L.P.: Platform to Drive an Intelligent Wheelchair Using Facial Expressions. In: Proceedings 9th Int.Conf. Enterprise Information Systems - Human-Computer Interaction, Funchal, Madeira, pp. 164–169 (2007)Google Scholar
  9. 9.
    Faria, P.M., Braga, R.A.M., Valgôde, E., Reis, L.P.: Interface framework to drive an intelligent wheelchair using facial expressions. In: IEEE International Symposium on Industrial Electronics (ISIE 2007), pp. 1791–1796 (2007)Google Scholar
  10. 10.
    Simpson, R.C.: Smart Wheelchairs: A Literature Review. Journal of Rehabilitation Research & Development 42, 423–436 (2005)CrossRefGoogle Scholar
  11. 11.
    IBM. Via Voice (June 2008), (Consulted on July 2008)
  12. 12.
    Braga, R.A.M., Malheiro, P., Reis, L.P.: Development of a Realistic Simulator for Robotic Intelligent Wheelchairs in a Hospital Environment. In: Baltes, J., Lagoudakis, M.G., Naruse, T., Shiry, S. (eds.) RoboCup 2009. LNCS (LNAI), vol. 5949, pp. 23–34. Springer, Heidelberg (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Luis Paulo Reis
    • 1
    • 2
  • Rodrigo A. M. Braga
    • 1
    • 2
  • Márcio Sousa
    • 1
  • Antonio Paulo Moreira
    • 1
  1. 1.FEUP – Faculty of Engineering of the University of PortoPortoPortugal
  2. 2.LIACC - Artificial Intelligence and Computer Science Lab.University of PortoPortugal

Personalised recommendations