Skip to main content

Augmented Reality Tactile Map with Hand Gesture Recognition

  • Conference paper
  • First Online:
Computers Helping People with Special Needs (ICCHP 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9759))

Abstract

Paper tactile maps are regarded as a very useful tool for pre-journey learning for visually-impaired people. In order to provide the solution for the perceptual difficulties and the limitation of the amount of contents of the paper tactile maps, we propose the augmented reality (AR) tactile map system. With our AR tactile map, the physical tactile map can be augmented by audio and visual feedbacks which are enlarging/enhancing the focused area and voice over of the POR/POI according to the user’s input. As the interface for the AR tactile map, we adopt intuitive user interfaces with hand gesture recognition by using an RGB-D camera. We implemented a prototype according to the requirements determined by the discussion including the visually-impaired people.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kurata, T.: Roles of navigation system in walking with long cane and guide dog. In: CSUN Conference (2014)

    Google Scholar 

  2. Ungar, S., et al.: The role of tactile maps in mobility training. Br. J. Vis. Impairment 11(3), 59–61 (1993)

    Article  Google Scholar 

  3. ISO/PRF 19028 Accessible design - Information contents, figuration and display methods of tactile guide maps (Under development)

    Google Scholar 

  4. Watanabe, T., Yamaguchi, T., Koda, S., Minatani, K.: Tactile map automated creation system using openstreetmap. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part II. LNCS, vol. 8548, pp. 42–49. Springer, Heidelberg (2014)

    Google Scholar 

  5. Higa, K., et al.: A two-by-two mixed reality system that merges real and virtual worlds in both audio and visual senses. In: Proceedings of ISMAR 2007, pp. 203–206 (2007)

    Google Scholar 

  6. O’Sullivan, L., Picinali, L., Feakes, C., Cawthorne, D.: Audio tactile maps (ATM) system for the exploration of digital heritage buildings by visually-impaired individuals - first prototype and preliminary evaluation. In: Forum Acousticum (2014)

    Google Scholar 

  7. Fusco, G., et al.: The tactile graphics helper: providing audio clarification for tactile graphics using machine vision. In: Proceedings of ASSETS 2015 (2015)

    Google Scholar 

  8. Okuno, K.: Smartphone-based talking navigation system for walking training. In: CSUN Conference 2015, IND-026 (2015)

    Google Scholar 

Download references

Acknowledgment

This research is partially supported by JST RISTEX.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Takeshi Kurata .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Ichikari, R., Yanagimachi, T., Kurata, T. (2016). Augmented Reality Tactile Map with Hand Gesture Recognition. In: Miesenberger, K., Bühler, C., Penaz, P. (eds) Computers Helping People with Special Needs. ICCHP 2016. Lecture Notes in Computer Science(), vol 9759. Springer, Cham. https://doi.org/10.1007/978-3-319-41267-2_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41267-2_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41266-5

  • Online ISBN: 978-3-319-41267-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics