Skip to main content
Book cover

International Conference on Computers for Handicapped Persons

ICCHP 2012: Computers Helping People with Special Needs pp 566–572Cite as

An Assistive Vision System for the Blind That Helps Find Lost Things

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 7383)

Abstract

We present a computer vision system that helps blind people find lost objects. To this end, we combine color- and SIFT-based object detection with sonification to guide the hand of the user towards potential target object locations. This way, we are able to guide the user’s attention and effectively reduce the space in the environment that needs to be explored. We verified the suitability of the proposed system in a user study.

Keywords

  • Lost & Found
  • Computer Vision
  • Sonification
  • Object Detection & Recognition
  • Visually Impaired
  • Blind

This is a preview of subscription content, access via your institution.

Chapter
EUR   29.95
Price includes VAT (Finland)
  • DOI: 10.1007/978-3-642-31534-3_83
  • Chapter length: 7 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
EUR   74.89
Price includes VAT (Finland)
  • ISBN: 978-3-642-31534-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
EUR   98.99
Price includes VAT (Finland)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amazon: Mechanical turk, https://www.mturk.com/

  2. Bigham, J.P., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz:LocateIt - enabling blind people to locate objects in their environment. In: Proc. CVPR Workshop: Computer Vision Applications for the Visually Impaired (2010)

    Google Scholar 

  3. Caperna, S., Cheng, C., et al.: A navigation and object location device for the blind. Tech. rep., University of Maryland, College Park (2009)

    Google Scholar 

  4. Collet, A., Martinez, M., Srinivasa, S.S.: The MOPED framework: Object recognition and pose estimation for manipulation. Int. J. Robotics Research 30(10), 1284–1306 (2011)

    CrossRef  Google Scholar 

  5. Constantinescu, A., Schultz, T.: Redundancy versus complexity in auditory displays for object localization - a pilot study. In: Proc. Int. Conf. Auditory Display (2011)

    Google Scholar 

  6. Durette, B., Louveton, N., Alleysson, D., Hrault, J.: Visuo-auditory sensory substitution for mobility assistance: Testing thevibe. In: Workshop on Computer Vision Applications for the Visually Impaired (2008)

    Google Scholar 

  7. Google Mobile: Google Goggles, http://www.google.com/mobile/goggles/

  8. Hub, A., Diepstraten, J., Ertl, T.: Design and development of an indoor navigation and object identification system for the blind. In: Proc. Int. ACM SIGACCESS Conf. Computers and Accessibility (2004)

    Google Scholar 

  9. Schauerte, B., Fink, G.A.: Web-based learning of naturalized color models for human-machine interaction. In: Proc. Int. Conf. Digital Image Computing: Techniques and Applications (2010)

    Google Scholar 

  10. Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends. Comput. Graph. Vis. 3, 177–280 (2008)

    CrossRef  Google Scholar 

  11. Wenqin, S., Wei, J., Jian, C.: A machine vision based navigation system for the blind. In: Proc. Int. Conf. Computer Science and Automation Engineering (2011)

    Google Scholar 

  12. Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: Proc. CVPR Workshop: Computer Vision Applications for the Visually Impaired (2010)

    Google Scholar 

  13. World Health Organization: Visual impairment and blindness, http://www.who.int/mediacentre/factsheets/fs282/en/

Download references

Author information

Authors and Affiliations

  1. Institute for Anthropomatics, Karlsruhe Institute of Technology, Adenauerring 2, Germany

    Boris Schauerte, Manel Martinez & Rainer Stiefelhagen

  2. Study Center for the Visually Impaired Students, Karlsruhe Institute of Technology, Engesserstr. 4, 76131, Karlsruhe, Germany

    Angela Constantinescu & Rainer Stiefelhagen

Authors
  1. Boris Schauerte
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manel Martinez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Angela Constantinescu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rainer Stiefelhagen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Linz, Institut Integriert Studieren, Altenbergerstraße 69, 4040, Linz, Austria

    Klaus Miesenberger

  2. University of San Francisco, 2130 Fulton St, 94117, San Francisco, CA, USA

    Arthur Karshmer

  3. Support Centre for Students with Special Needs, Masaryk University, Botanická 68A, 602 00, Brno, Czech Republic

    Petr Penaz

  4. Institute “integriert studieren”, Vienna University of Technology, Favoritenstr. 11/029, 1040, Vienna, Austria

    Wolfgang Zagler

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schauerte, B., Martinez, M., Constantinescu, A., Stiefelhagen, R. (2012). An Assistive Vision System for the Blind That Helps Find Lost Things. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2012. Lecture Notes in Computer Science, vol 7383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31534-3_83

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31534-3_83

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31533-6

  • Online ISBN: 978-3-642-31534-3

  • eBook Packages: Computer ScienceComputer Science (R0)