KinDectect: Kinect Detecting Objects

  • Atif Khan
  • Febin Moideen
  • Juan Lopez
  • Wai L. Khoo
  • Zhigang Zhu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7383)

Abstract

Detecting humans and objects in images has been a very challenging problem due to variation in illumination, pose, clothing, background and other complexities. Depth information is an important cue when humans recognize objects and other humans. In this work we utilize the depth information that a Kinect sensor - Xtion Pro Live provides to detect humans and obstacles in real time for a blind or visually impaired user. The system runs in two modes. For the first mode, we focus on how to track and/or detect multiple humans and moving objects and transduce the information to the user. For the second mode, we present a novel approach on how to avoid obstacles for safe navigation for a blind or visually-impaired user in an indoor environment. In addition, we present a user study with some blind-folded users to measure the efficiency and robustness of our algorithms and approaches.

Keywords

Obstacle Avoidance Depth Information Human Detection Kinect Sensor Obstacle Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Zöllner, M., Huber, S., Jetter, H.-C., Reiterer, H.: NAVI – A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part IV. LNCS, vol. 6949, pp. 584–587. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  2. 2.
    Bourbakis, N.: Sensing Surround 3-D Space for Navigation of the Blind. IEEE Engineering in Medicine and Biology Magazine 27(1) (January-February 2008)Google Scholar
  3. 3.
    Meers, S., Ward, K.: A Substitute Vision System for Providing 3D Perception and GPS Navigation via Electro-Tactile Stimulation. School of IT and Computer Science University of Wollongong, Wollongong, NSW, Australia (2005)Google Scholar
  4. 4.
    Cunha, J., et al.: Using a Depth Camera for Indoor Robot Localization and Navigation. DETI/IEETA- University of Aveiro, Portugal (2011)Google Scholar
  5. 5.
    Dakopoulos, D., Bourbakis, N.: Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey. IEEE Trans. on Systems, Man, and Cybernetics, January 1 (2010)Google Scholar
  6. 6.
    Xia, L., Chen, C.-C., Aggarwal, J.K.: Human Detection Using Depth Information by Kinect. In: International Workshop on Human Activity Understanding from 3D Data in Conjunction with CVPR (HAU3D), Colorado Springs, CO (June 2011)Google Scholar
  7. 7.
    Ran, L., Helal, S., Moore, S.: Drishti: An Integrated Indoor/Outdoor Blind Navigation System and Service. In: PerCom, pp. 23–32 (2004)Google Scholar
  8. 8.
    Cardin, S., Thalmann, D., Vexo, F.: Wearable Obstacle Detection System for visually impaired People. Visual Computer: International Journal of Computer Graphics archive 23(2) (January 2007)Google Scholar
  9. 9.
  10. 10.
  11. 11.
    MSDNS. SAPI Function. Microsoft, August 28 (2008), http://msdn.microsoft.com/en-us/library/aa911241.aspx

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Atif Khan
    • 1
  • Febin Moideen
    • 1
  • Juan Lopez
    • 1
  • Wai L. Khoo
    • 1
  • Zhigang Zhu
    • 1
  1. 1.Department of Computer ScienceCity College of New YorkNew YorkUSA

Personalised recommendations