Fingertip Guiding Manipulator: Haptic Graphic Display for Mental Image Creation

  • Yoshihiko Nomura
  • Yuki Yagi
  • Tokuhiro Sugiura
  • Hirokazu Matsui
  • Norihiko Kato
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


A fingertip guiding manipulator was developed as a haptic graphic display for blind people: it helps them create mental images of raised graphics and reliefs with stroke order. Through fingertip kinesthetic sense, while foreseeing the direction of the upcoming stroke by perceiving the knob’s direction, users experience the uplifted and fallen strokes by perceiving their fingertips being pulled in the horizontal and vertical directions. Especially, the up-lifting function expands a representation capability from “single stroke graphics” to “multiple stroke graphics.


Mental Image Haptic Device Blind People Haptic Interface Blind Person 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Beddoes, M.P., Suen, C.Y.: Evaluation and a Method of Presentation of the Sound Output From the Lexiphone -A Reading Machine for the Blind. IEEE Transactions On Bio-Medical BME-18(2), 85–91 (1971)CrossRefGoogle Scholar
  2. 2.
    Simizu, Y., Saida, S., Shimura, H.: Tactile pattern recognition by graphic display: Importance of 3-D information for haptic perception of familiar objects. Perception & Psychophysics 53, 43–48 (1993)CrossRefGoogle Scholar
  3. 3.
    Tang, H., Beebe, D.J.: A Microfabricated Electrostatic Haptic Display for Persons with Visual Impairments. IEEE Transactions On Rehabilitation Engineering 6(3), 241–248 (1998)CrossRefGoogle Scholar
  4. 4.
    Shimojo, M., Shinohara, M., Fukui, Y.: Human shape recognition performance for 3D tactile display. IEEE Transactions on Systems, Man, and Cybernetics, Part A 29(6), 637–644 (1999)CrossRefGoogle Scholar
  5. 5.
    Kobayashi, M., Watanabe, T.: Communication System for the Blind Using Tactile Displays and Ultrasonic Pens-MIMIZU. In: Miesenberger, K., Klaus, J., Zagler, W., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 731–738. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Blenkhorn, P., Evans, D.G.: Using speech and touch to enable blind people to access schematic diagrams. Journal of Network and Computer Applications 21, 17–29 (1998)CrossRefGoogle Scholar
  7. 7.
    Nomura, Y., Nishihama, S., Ozaki, M., Sugiura, T.: Image Pattern Perception by Interactive Sound Presentation. In: Proceedings of 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, CD-ROM, paper No. 369 (2001)Google Scholar
  8. 8.
    Nomura, Y., Nishihama, S., Sugiura, T., Matsui, H., Kato, N.: Auditory Sensation Aided Image Perception: Integration of Somesthetic Sense of Fingertip Position. In: Miesenberger, K., Klaus, J., Zagler, W. (eds.) ICCHP 2002. LNCS, vol. 2398, pp. 448–454. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Nomura, Y., Kakehashi, H., Sugiura, T., Kato, N.: Mental Map Creation Support System for Blind Person –Fusion of Verbal Message and Somesthec Sense. In: Proceedings of HCI International 2003, vol. 48, pp. 1315–1319 (2003)Google Scholar
  10. 10.
    Nomura, Y., Kakehashi, H., Sugiura, T., Matsui, H., Kato, N.: An Indicating, Leading Manipulator as a Good Hand at Teaching Strokes: A Mental-Image-Creation Support System. In: Miesenberger, K., Klaus, J., Zagler, W., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 705–712. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  11. 11.
    Nomura, Y., Omoto, M., Sugiura, T., Kato, N., Matsui, H.: Direction-Indicating, Traction Manipulator to Support Mental Image Creation of Line Drawings. In: CD-ROM Proceedings of HCI International 2005, pp. 1–6 (2005)Google Scholar
  12. 12.
    Takanashi, Y., Terada, T., Inoue, K., Ito, Y., Lee, H., Komeda, T.: Upper-Limb Rehabilitation Exercise Using Haptic Device System. International Journal of Human-friendly Welfare Robotic Systems 4(2), 18–22 (2003)Google Scholar
  13. 13.
    Walairacht, S., Ishii, M., Koike, Y., Sato, M.: Two-Handed Multi-Fingers String-Based Haptic Interface. IEICE Trans. Inf.&Syst. E84-D(3) (2001)Google Scholar
  14. 14.
    Kawasaki, H., Hori, T., Mouri, T.: Multi-Fingered Haptic Interface Opposed to Human Hand. J. Robotics Society of Japan 23(4), 449–456 (2005) (in Japanese)Google Scholar
  15. 15.
    Inami, N., Tomonaga, H., Matsubara, Y., Yamasaki, Y.: Pencil Touch Learning System for Japanese Handwriting Based on the Haptic Device. Trans. Institute of Electronics, Information and Communication Engineers. D-I J87-D-I(12), 1128–1135 (2004) (in Japanese)Google Scholar
  16. 16.
    Nikolakis, G., Moustakas, K., Tzovaras, D., Strintzis, M.G.: Haptic representation of images for the blind and the visually impaired. In: CD-ROM Proc. HCI International (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yoshihiko Nomura
    • 1
  • Yuki Yagi
    • 1
  • Tokuhiro Sugiura
    • 1
  • Hirokazu Matsui
    • 1
  • Norihiko Kato
    • 1
  1. 1.Graduate School of EngineeringMie UniversityTsu, MieJapan

Personalised recommendations