Skip to main content
SpringerLink
Log in

Smartphone Navigation Support for Blind and Visually Impaired People - A Comprehensive Analysis of Potentials and Opportunities

  • Conference paper
  • First Online:
Universal Access in Human-Computer Interaction. Applications and Practice (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12189))

Included in the following conference series:

Abstract

Smartphones are indispensable tools for many people for various assistive tasks. They are equipped with different sensors that provide data on motion, location and the environment. This paper explores the various sensors and output modalities existing in a smartphone to make it useful as a navigation support device for blind and visually impaired users. In addition, different usecase scenarios were also scrutinized where the potential of a smartphone as a navigation device can be explored further. The technology holds potential for the implementation of successful navigation support system by utilizing the various sensors and features existing in a smartphone. This in-depth analysis of the various possibilities with a smartphone in the navigation support system design might become useful in the further research in the domain.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.gari.info.

  2. 2.

    https://www.ces.tech.

  3. 3.

    https://www.tensorflow.org/lite.

References

  1. Ahmetovic, D., Gleason, C., Kitani, K.M., Takagi, H., Asakawa, C.: NavCog: turn-by-turn smartphone navigation assistant for people with visual impairments or blindness. In: Proceedings of the 13th Web for All Conference, p. 9. ACM (2016)

    Google Scholar 

  2. Al-Khalifa, S., Al-Razgan, M.: Ebsar: indoor guidance for the visually impaired. Comput. Electri. Eng. 54, 26–39 (2016)

    Article  Google Scholar 

  3. Alghamdi, S., Van Schyndel, R., Alahmadi, A.: Indoor navigational aid using active RFID and QR-code for sighted and blind people. In: 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing, pp. 18–22. IEEE (2013)

    Google Scholar 

  4. AlZuhair, M.S., Najjar, A.B., Kanjo, E.: NFC based applications for visually impaired people - a review. In: 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6. IEEE (2014)

    Google Scholar 

  5. Batt, S.: How an accelerometer in a smartphone works to track your movement? April 2019. https://www.maketecheasier.com/how-accelerometer-works/. Accessed Jan 2020

  6. BeMyEyes: Bringing sight to blind and low-vision people, September 2003. https://www.bemyeyes.com/. Accessed Jan 2020

  7. Bolton, N.: The Advantages of Using Wi-Fi on Your Smartphone, October 2016. https://smallbusiness.chron.com/advantages-using-wifi-smartphone-71651.html. Accessed Jan 2020

  8. Botzer, A., Shvalb, N., et al.: Using sound feedback to help blind people navigate. In: Proceedings of the 36th European Conference on Cognitive Ergonomics, p. 23. ACM (2018)

    Google Scholar 

  9. Carter, D., Barlow, J.: Understanding how blind pedestrians cross at signalized intersections, March 2009. http://www.apsguide.org/appendix_d_understanding.cfm. Accessed Jan 2020

  10. Chang, A., O’Sullivan, C.: Audio-haptic feedback in mobile phones. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1264–1267. ACM (2005)

    Google Scholar 

  11. Ciaffoni, L.: An innovative app for your mobility, June 2011. https://www.ariadnegps.eu/. Accessed Jan 2020

  12. Corp, A.T.: Seeing Eye GPS, June 2013. https://apps.apple.com/us/app/seeing-eye-gps/id668624446. Accessed January 2020

  13. Corp, S.E.: Gyro sensors - How they work and what’s ahead: about Gyro sensor: Technical Information: other Information, May 2010. https://www5.epsondevice.com/en/information/technical_info/gyro/. Accessed Jan 2020

  14. Csapó, Á., Wersényi, G., Nagy, H., Stockman, T.: A survey of assistive technologies and applications for blind users on mobile platforms: a review and foundation for research. J. Multimodal User Interfaces 9(4), 275–286 (2015)

    Article  Google Scholar 

  15. Dagar, S.: Braille Phone, August 2018. https://dagar.me/braille-phone. Accessed Jan 2020

  16. Das, R.C., Alam, T.: Location based emergency medical assistance system using OpenstreetMap. In: 2014 International Conference on Informatics, Electronics & Vision (ICIEV), pp. 1–5. IEEE (2014)

    Google Scholar 

  17. Developers, A.: Sensors Overview : Android Developers, December 2011. https://developer.android.com/guide/topics/sensors/sensors_overview. Accessed Jan 2020

  18. Esmaeili Kelishomi, A., Garmabaki, A., Bahaghighat, M., Dong, J.: Mobile user indoor-outdoor detection through physical daily activities. Sensors 19(3), 511 (2019)

    Article  Google Scholar 

  19. GmbH: LowViz Guide Indoor Navigation, May 2015. https://apps.apple.com/us/app/lowviz-guide-indoor-navigation/id987917857. Accessed Jan 2020

  20. González-Cañete, F., Rodríguez, J.L., Galdón, P., Díaz-Estrella, A.: Improvements in the learnability of smartphone haptic interfaces for visually impaired users. PLoS One 14(11), e0225053 (2019)

    Article  Google Scholar 

  21. Graves, K.: 5G Will Spur New Opportunities for Americans with Disabilities, May 2018. https://www.ctia.org/news/5g-will-spur-new-opportunities-for-americans-with-disabilities. Accessed Jan 2020

  22. Heredia, A., Barros-Gavilanes, G.: Video processing inside embedded devices using SSD-MobileNet to count mobility actors. In: 2019 IEEE Colombian Conference on Applications in Computational Intelligence (ColCACI), pp. 1–6. IEEE (2019)

    Google Scholar 

  23. Hoffman, C.: What is NFC (Near Field Communication), and What Can I Use It For, May 2018. https://www.howtogeek.com/137979/htg-explains-what-is-nfc-and-what-can-i-use-it-for/. Accessed Jan 2020

  24. Holly: How do blind and visually impaired people use a mobile phone?, February 2019. https://lifeofablindgirl.com/2019/02/03/how-do-blind-and-visually-impaired-people-use-a-mobile-phone/. Accessed Jan 2020

  25. Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)

  26. Huang, G., Liu, S., Van der Maaten, L., Weinberger, K.Q.: CondenseNet: an efficient densenet using learned group convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2752–2761 (2018)

    Google Scholar 

  27. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: alexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360 (2016)

  28. Idrees, A., Iqbal, Z., Ishfaq, M.: An efficient indoor navigation technique to find optimal route for blinds using QR codes. In: 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA), pp. 690–695. IEEE (2015)

    Google Scholar 

  29. Ignatov, A., et al.: AI benchmark: running deep neural networks on Android smartphones. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)

    Google Scholar 

  30. Islam, N., Want, R.: Smartphones: past, present, and future. IEEE Pervasive Comput. 13(4), 89–92 (2014)

    Article  Google Scholar 

  31. Lane, N.D., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., Campbell, A.T.: A survey of mobile phone sensing. IEEE Commun. Magazine 48(9), 140–150 (2010)

    Article  Google Scholar 

  32. Lasher, L.: GetThere GPS nav for blind - apps on Google Play, November 2016. https://play.google.com/store/apps/details?id=com.LewLasher.getthere&hl=en Accessed Jan 2020

  33. Ligero, R.: Beacons: the cornerstone of indoor positioning, September 2019. https://accent-systems.com/blog/beacons-the-cornerstone-of-indoor-positioning/. Accessed Jan 2020

  34. Lin, B.S., Lee, C.C., Chiang, P.Y.: Simple smartphone-based guiding system for visually impaired people. Sensors 17(6), 1371 (2017)

    Article  Google Scholar 

  35. Lin, S., Wang, K., Yang, K., Cheng, R.: KrNet: a kinetic real-time convolutional neural network for navigational assistance. In: Miesenberger, K., Kouroupetroglou, G. (eds.) ICCHP 2018. LNCS, vol. 10897, pp. 55–62. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-94274-2_9

    Chapter  Google Scholar 

  36. Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48

    Chapter  Google Scholar 

  37. Loomis, J., Golledge, R., Klatzky, R.: GPS-based navigation systems for the visually impaired. Fundamentals of Wearable Computers and Augmented Reality, January 2001

    Google Scholar 

  38. Masoud, M., Jaradat, Y., Manasrah, A., Jannoud, I.: Sensors of smart devices in the internet of everything (IOE) era: big opportunities and massive doubts. J. Sensors 2019, 1–9 (2019)

    Article  Google Scholar 

  39. Meliones, A., Filios, C.: Blindhelper: a pedestrian navigation system for blinds and visually impaired. In: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, p. 26. ACM (2016)

    Google Scholar 

  40. Murata, M., Ahmetovic, D., Sato, D., Takagi, H., Kitani, K.M., Asakawa, C.: Smartphone-based indoor localization for blind navigation across building complexes. In: 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 1–10. IEEE (2018)

    Google Scholar 

  41. Nield, D.: All the sensors in your smartphone, and how they work, August 2018. https://gizmodo.com/all-the-sensors-in-your-smartphone-and-how-they-work-1797121002. Accessed Jan 2020

  42. Pirttimaa, I.: What is BlindSquare? September 2012. https://www.blindsquare.com/about/. Accessed Jan 2020

  43. Pocket-lint: what is a ToF camera and which phones have one? March 2019. https://www.pocket-lint.com/phones/news/147024-what-is-a-time-of-flight-camera-and-which-phones-have-it. Accessed Jan 2020

  44. Poggi, M., Mattoccia, S.: A wearable mobility aid for the visually impaired based on embedded 3D vision and deep learning. In: 2016 IEEE Symposium on Computers and Communication (ISCC), pp. 208–213. IEEE (2016)

    Google Scholar 

  45. Priyadarshini, M.: Which sensors do i have in my smartphone? how do they work? April 2019. https://fossbytes.com/which-smartphone-sensors-how-work/. Accessed Jan 2020

  46. Rantala, J., et al.: Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. IEEE Trans. Haptics 2(1), 28–39 (2009)

    Article  Google Scholar 

  47. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)

  48. Shangguan, L., Yang, Z., Zhou, Z., Zheng, X., Wu, C., Liu, Y.: Crossnavi: enabling real-time crossroad navigation for the blind with commodity phones. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 787–798. ACM (2014)

    Google Scholar 

  49. Sharma, S., SharmaSagar, S.: What is the use of accelerometer in mobile devices? October 2019. https://www.credencys.com/blog/accelerometer/. Accessed Jan 2020

  50. Shen, H., Chan, K.Y., Coughlan, J., Brabyn, J.: A mobile phone system to find crosswalks for visually impaired pedestrians. Technol. Disabil. 20(3), 217–224 (2008)

    Article  Google Scholar 

  51. Spiers, A.J., Dollar, A.M.: Design and evaluation of shape-changing haptic interfaces for pedestrian navigation assistance. IEEE Trans. Haptics 10(1), 17–28 (2016)

    Article  Google Scholar 

  52. Spiers, A.J., Van Der Linden, J., Wiseman, S., Oshodi, M.: Testing a shape-changing haptic navigation device with vision-impaired and sighted audiences in an immersive theater setting. IEEE Trans. Hum. Mach. Syst. 48(6), 614–625 (2018)

    Article  Google Scholar 

  53. Tillu, J.: Mobile sensors: the components that make our smartphones smarter, June 2019. https://medium.com/jay-tillu/mobile-sensors-the-components-that-make-our-smartphones-smarter-4174a7a2bfc3. Accessed Jan 2020

  54. Ventola, C.L.: Mobile devices and apps for health care professionals: uses and benefits. Pharm. Therapeutics 39(5), 356 (2014)

    Google Scholar 

  55. Walkhighlands: Use of GPS and Smartphones as navigation aids, August 2012. https://www.walkhighlands.co.uk/safety/gps-smartphones.shtml. Accessed Jan 2020

  56. Wang, R.J., Li, X., Ling, C.X.: Pelee: a real-time object detection system on mobile devices. In: Advances in Neural Information Processing Systems, pp. 1963–1972 (2018)

    Google Scholar 

  57. Watanabe, T., Miyagi, M., Minatani, K., Nagaoka, H.: A survey on the use of mobile phones by visually impaired persons in Japan. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 1081–1084. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-70540-6_162

    Chapter  Google Scholar 

  58. Weiss, M., Luck, M., Girgis, R., Pal, C.J., Cohen, J.P.: A survey of mobile computing for the visually impaired. ArXiv abs/1811.10120 (2018)

    Google Scholar 

  59. Yeo, K.: Bluetooth LE: a new standard that could enable smaller true wireless headphones, January 2020. https://www.hardwarezone.com.sg/tech-news-bluetooth-le-new-wireless-standard. Accessed Jan 2020

  60. Zhang, X., Zhou, X., Lin, M., Sun, J.: ShuffleNet: an extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6848–6856 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Oslo Metropolitan University, Oslo, Norway

    Bineeth Kuriakose, Raju Shrestha & Frode Eika Sandnes

Authors
  1. Bineeth Kuriakose
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Raju Shrestha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frode Eika Sandnes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bineeth Kuriakose .

Editor information

Editors and Affiliations

  1. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  2. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kuriakose, B., Shrestha, R., Sandnes, F.E. (2020). Smartphone Navigation Support for Blind and Visually Impaired People - A Comprehensive Analysis of Potentials and Opportunities. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Applications and Practice. HCII 2020. Lecture Notes in Computer Science(), vol 12189. Springer, Cham. https://doi.org/10.1007/978-3-030-49108-6_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49108-6_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49107-9

  • Online ISBN: 978-3-030-49108-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation