Abstract
Object recognition solutions for the visually impaired based on a single modality cannot provide optimal performance under all circumstances, since each modality is best suited for particular usage scenarios. An object recognition application for the visually impaired, meant for a RFID-enabled tablet, which combines three approaches – RFID-based, visual-tag computer vision based and non-visual tag computer vision based – into a single piece of software is, therefore, presented in this paper. This solution has the benefits of being portable, accessible, low cost (the user needs only an RFID-enabled tablet, some inexpensive passive RFID tags and some visual tags (which can be printed out for free)) and more robust in a wider range of conditions than the approaches it is comprised of. The application will be adapted to other mobile platforms and devices (e.g., RFID-enabled smartphones) in the future.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zuckerman, D.M.: Blind Adults in America: Their Lives and Challenges. National Center for Policy Research for Women & Families, Washington DC (2004)
WHO Media Center. Visual impairment and blindness: Fact sheet number 282, http://www.who.int/mediacentre/factsheets/fs282/en/
Murad, M., Rehman, A., Shah, A.A., Ullah, S., Fahad, M., Yahya, K.M.: RFAIDE – An RFID Based Navigation and Object Recognition Assistant for Visually Impaired People. In: Proceedings of ICET 2011, pp. 1–4. IEEE (2011)
Lawson, M.A., Do, E.Y.-L., Marston, J.R., Ross, D.A.: Helping Hands versus ERSP Vision: Comparing object recognition technologies for the visually impaired. In: Stephanidis, C. (ed.) Posters, Part I, HCII 2011. CCIS, vol. 173, pp. 383–388. Springer, Heidelberg (2011)
Sudol, J., Dialameh, O., Blanchard, C., Dorcey, T.: Looktel - Comprehensive platform for computer-aided visual assistance. In: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), vol. I, pp. 73–80. IEEE Computer Society (2010)
Schauerte, B., Martinez, M., Constantinescu, A., Stiefelhagen, R.: An Assistive Vision System for the Blind That Helps Find Lost Things. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 566–572. Springer, Heidelberg (2012)
Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), vol. I, pp. 49–56. IEEE Computer Society (2010)
Bigham, J., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz: LocateIt - enabling blind people to locate objects in their environment. In: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), vol. I, pp. 65–72. IEEE Computer Society (2010)
Jafri, R., Ali, S.A., Arabnia, H.R., Fatima, S.: Computer Vision-based object recognition for the visually impaired in an indoors environment: a survey. In: The Visual Computer. Springer, Heidelberg (2013)
Jafri, R., Ali, S.A., Arabnia, H.R.: Computer Vision-based object recognition for the visually impaired using visual tags. In: Arabnia, H., Deligiannidis, L., Lu, J., Tinetti, F., You, J., et al. (eds.) Proceedings of IPCV 2013, pp. 400–406. CSREA Press, USA (2013), doi:10.1007/s00371-013-0886-1
McDaniel, T.L., Kahol, K., Villanueva, D., Panchanathan, S.: Integration of RFID and computer vision for remote object perception for individuals who are blind. In: Proceedings of the 2008 Ambi-Sys workshop on Haptic User Interfaces in Ambient Media Systems (HAS 2008), pp. 1–10. ICST Brussels, Belgium (2008)
Semacode Corporation, http://semacode.com/about/
Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding 110(3), 346–359 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Jafri, R., Ali, S.A. (2014). A Multimodal Tablet–Based Application for the Visually Impaired for Detecting and Recognizing Objects in a Home Environment. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham. https://doi.org/10.1007/978-3-319-08596-8_55
Download citation
DOI: https://doi.org/10.1007/978-3-319-08596-8_55
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08595-1
Online ISBN: 978-3-319-08596-8
eBook Packages: Computer ScienceComputer Science (R0)