Mobile Robots for an E-Mail Interface for People Who Are Blind

  • V. Estivill-Castro
  • S. Seymon
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4434)


The availability of inexpensive robotic hardware has brought to realization the dream of having autonomous mobile robots around us. As such, the research community has recently manifested more interest in assisting robotic technology (see proceedings of the last two IEEE RO-MAN conferences, the emergence of the RoboCup@Home challenge at RoboCup and the first annual Human Computer Interaction Conference jointly sponsored by IEEE and ACM). Robots provide to the blind what was lost as textual interfaces were replaced by GUIs. This paper describes the design, implementation and testing of a first prototype of a multi-modal Human-Robot Interface for people with Vision Impairment. The robot used is the commercially available four legged SONY Aibo.


Mobile Robot Gesture Recognition Ambient Intelligence Voice Record User Centre Design 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bartlett, B., Estivill-Castro, V., Seymon, S., Tourky, A.: Robots for pre-orientation and interaction of toddlers and preschoolers who are blind. In: Roberts, J., Wyeth, G., (eds.) Proceedings of the 2003 Australasian Conference on Robotics and Automation, ACRA. CSIRO’s (QCAT), Brisbane, Australia (December 1-3, 2003) Google Scholar
  2. 2.
    Blenkhorn, P., Evans, D.: Using speech and touch to enable blind people to access schematic diagrams. Journal of Network and Computer Applications 21, 17–29 (1988)CrossRefGoogle Scholar
  3. 3.
    Ghidary, S.S., Nakata, Y., Saito, H., Hattori, M., Takamori, T.: Multi-modal interaction of human and home robot in the context of room map generation. Autonomous Robots Journal 13(2), 169–184 (2002)zbMATHCrossRefGoogle Scholar
  4. 4.
    Graf, B., Hans, M., Schraft, R.D.: Care-O-bot II — development of a next generation robotic home assistant. Auton. Robots 16(2), 193–205 (2004)CrossRefGoogle Scholar
  5. 5.
    Hoshino, A., Kato, K., Takeuchi, J.: A chat information service system using a humanoid robot. In: Hoshino, A., Kato, K., Takeuchi, J. (eds.) 14th IEEE International Workshop on Robot and Human Interactive Communication, IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  6. 6.
    Kulyukin, V., Gharpure, C.: Ergonomics-for-one in a robotic shopping cart for the blind. In: HRI 2006. Proceedings of the 2006 ACM Conference on Human-Robot Interaction, Salt Lake City, Utah, ACM Press (to appear)Google Scholar
  7. 7.
    Kulyukin, V., Gharpure, C., Nicholson, J., Pavithran, S.: RFID in robot-assisted indoor navigation for the visually impaired. In: IROS 2004. IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan (2004)Google Scholar
  8. 8.
    Leventhal, J., Uslan, M., Schreier, E.: A review of Braille printers. Journal of Visual Impairment and Blindness 85, 364–350 (1991)Google Scholar
  9. 9.
    Oviatt, S.: Ten myths of multimodal interaction. Communications of the ACM 42(11), 74–81 (1999)CrossRefGoogle Scholar
  10. 10.
    Raisinghan, M.S., Benoit, A., Ding, J., Gomez, M., Gupta, K., Gusila, V., Power, D., Schmedding, O.: Ambient Intelligence: Changing forms of human-computer interaction and their social implications. Journal of Digital Information 5(4), 8–24 (2004)Google Scholar
  11. 11.
    Raskin, J.: The Humane Interface. New Directions for Designing Interactive Systems. Addison-Wesley Publishing Co., Reading, MA (2000)Google Scholar
  12. 12.
    Remagnino, P., Foresti, G.L., Ellis, T. (eds.): Ambient Intelligence. Springer, Berlin (2005)Google Scholar
  13. 13.
    Shneiderman, B.: Designing the User Interface, 3rd edn. Addison-Wesley Publishing Co, Reading, MA (1998)Google Scholar
  14. 14.
    Steinfeld, A.: Interface lessons for fully and semi-autonomous mobile robots (2004)Google Scholar
  15. 15.
    Sutcliffe, A.G.: Human-Computer Interface Design, 2nd edn. MacMillan, London (1998)Google Scholar
  16. 16.
    Takahashi, Y., Jones, J., Koyama, H., Komeda, T.: Development of the assistive mobile robot system for coexisting and cooperating with human beings. Advanced Robotics 18, 473–496 (2004)CrossRefGoogle Scholar
  17. 17.
    Tanaka, F., Fortenberry, B., Aisaka, K., Movellan, J.R.: Developing dance interaction between QRIO and toddlers in a classroom environment: Plans for the first steps. In: RO-MAN 2005. 2005 IEEE International Workshop on Robot and Human Interactive Communication, Nashville USA, pp. 223–228. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  18. 18.
    Vanderheiden, G.C.: Nonvisual alternative displays techniques for output from graphical-based computers. Journal of Visual Impairment and Blindness 83(8), 383–390 (1989)Google Scholar
  19. 19.
    Werry, I., Dautenhahn, K., Odgen, B., Harwin, W.: Can social interactionskills be taught by a social agent? the role of a robotic mediator in autism therapy. In: Beynon, M., Nehaniv, C.L., Dautenhahn, K. (eds.) CT 2001. LNCS (LNAI), vol. 2117, pp. 57–74. Springer, Heidelberg (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • V. Estivill-Castro
    • 1
  • S. Seymon
    • 1
  1. 1.School of ICT, Griffith University, Nathan QLD 4111, BrisbaneAustralia

Personalised recommendations