Advertisement

A Smartphone-Based Virtual White Cane Prototype Featuring Time-of-Flight 3D Imaging

Chapter
  • 726 Downloads

Abstract

Thanks to the advancements in Time-of-Flight depth perception technologies, new approaches emerge to support visually impaired people in their everyday life. This chapter presents a novel Electronic Travel Aid prototype based on a miniaturized and smartphone integrated Time-of-Flight 3D imaging camera. The presented Electronic Travel Aid prototype robustly detects obstacles, thanks to the introduction of two innovative concepts: a combination of v disparity and RANSAC algorithm and the so-called Conservative Polar Histogram. An obstacle detection and warning rate of up to 7 FPS is achieved by the prototype. Furthermore, our prototype considerably outperforms the object detection performance compared to state-of-the-art approaches.

Keywords

Virtual White Cane Time-of-Flight 3D sensing RANSAC v Disparity Conservative Polar Histogram 

Notes

Acknowledgements

This project has received funding from the Electronic Component Systems for European Leadership Joint Undertaking under grant agreement No 692480. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and Germany, Netherlands, Spain, Austria, Belgium, and Slovakia.

Glossary

BOVW

Bag-of-Visual-Words

ETA

Electronic Travel Aid

EOA

Electronic Orientation Aid

FOV

Field of View

GPGPU

General Purpose Graphics Processing Unit

HRTF

Head-Related Transfer Function

PLD

Position Locator Device

RANSAC

RANdom SAmple Consensus

RGB-D

Color and Depth sensing Camera

SURF

Speeded Up Robust Feature

SVM

Support Vector Machine

ToF

Time-of-Flight

References

  1. 1.
    N. Druml, T. Pietsch, M. Dielacher, C. Steger, M. Baumgart, C. Consani, T. Herndl, G. Holweg, Virtual white cane featuring time-of-flight 3D imaging supporting visually impaired users, in 2018 21st Euromicro Conference on Digital System Design (DSD), (2018), pp. 450–457CrossRefGoogle Scholar
  2. 2.
    D. Dakopoulos, N.G. Bourbakis, Wearable obstacle avoidance electronic travel aids for blind: A survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 40(1), 25–35 (2010)CrossRefGoogle Scholar
  3. 3.
    D. Bernabei, F. Ganovelli, M.D. Benedetto, M. Dellepiane, R. Scopigno, A low-cost time-critical obstacle avoidance system for the visually impaired, in International Conference on Indoor Positioning and Indoor Navigation, (2011), pp. 21–23Google Scholar
  4. 4.
    M. Vlaminck, L. Jovanov, P. Van Hese, B. Goossens, W. Philips, A. Pizurica, Obstacle detection for pedestrians with a visual impairment based on 3D imaging, in 2013 International Conference on 3D Imaging, (2013)Google Scholar
  5. 5.
    J.M. Coughlan, A. Yuille, Manhattan world: Compass direction from a single image by Bayesian inference, in Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, (1999)Google Scholar
  6. 6.
    J. Poppinga, N. Vaskevicius, A. Birk, K. Pathak, Fast plane detection and polygonalization in noisy 3D range images, in 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, (2008), pp. 3378–3383CrossRefGoogle Scholar
  7. 7.
    M. Brock, P.O. Kristensson, Supporting blind navigation using depth sensing and sonification, in Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication—UbiComp ‘13 Adjunct, (2013)Google Scholar
  8. 8.
    A. Bhowmick, S. Prakash, R. Bhagat, V. Prasad, S. M. Hazarika, IntelliNavi: Navigation for blind based on kinect and machine learning, in Multi-disciplinary Trends in Artificial Intelligence (2014)Google Scholar
  9. 9.
    R. Jafri, A GPU-accelerated real-time contextual awareness application for the visually impaired on Google’s project Tango device (2016)Google Scholar
  10. 10.
    R. Labayrade, D. Aubert, J.-P. Tarel, Real Time Obstacle Detection in Stereovision on Non Flat Road Geometry Through “v-disparity” Representation, vol 2 (2002), pp. 646–651Google Scholar
  11. 11.
    A. Broggi, C. Caraffi, R.I. Fedriga, P. Grisleri, Obstacle detection with stereo vision for off-road vehicle navigation, in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05)-Workshops, (2005), p. 65Google Scholar
  12. 12.
    N. Soquet, D. Aubert, N. Hautiere, Road Segmentation Supervised by an Extended V-Disparity Algorithm for Autonomous Navigation (2007), pp. 160–165Google Scholar
  13. 13.
    B. Musleh, A. De La Escalera, J.M. Armingol, U-V disparity analysis in urban environments, in Lecture Notes in Computer Science, vol. 6928, (2012), pp. 426–432Google Scholar
  14. 14.
    Y. Gao, X. Ai, J. Rarity, N. Dahnoun, Obstacle detection with 3D camera using U-V-disparity, in International Workshop on Systems, Signal Processing and Their Applications, WOSSPA, (2011)Google Scholar
  15. 15.
    B. Peasley, S.T. Birchfield, Real-time obstacle detection and avoidance in the presence of specular surfaces using an active 3D sensor, in 2013 IEEE Workshop on Robot Vision (WORV), (2013)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Infineon Technologies Austria AGGrazAustria
  2. 2.Photonic Systems, CTR Carinthian Tech Research AGVillachAustria

Personalised recommendations