Skip to main content
SpringerLink
Log in

Reliable People Detection Using Range and Intensity Data from Multiple Layers of Laser Range Finders on a Mobile Robot

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

Reliable people detection is an important task in several areas like security, intelligent environments and human robot interaction. People detection does not depend only upon separation of static environment objects from those showing motion (hopefully humans), a reliable system should be able to detect static people even in cluttered environments.

This work presents a reliable approach for people detection and position estimation using multiple layers of Laser Range Finders (LRF) on a mobile robot. Each layer combines two LRF sensors to scan around the robot’s surroundings and are vertically separated to detect distinct parts of the human body. By using AdaBoost we create strong classifiers to detect body parts, candidate segments in each layer are fused for people detection, and we use simple data association to estimate their positions. Additionally, this work introduces laser reflection intensity as a novel property for people detection. First, we present a study of laser intensity and textiles, then introduce new intensity-based features for detection, and propose a method for segment separation using laser intensity. We provide a thorough evaluation of our multi-layered system though several experiments on a mobile robot.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Burgard W, Cremers AB, Fox D, Hähnel D, Lakemeyer G, Schulz D, Steiner W, Thrun S (1998) The interactive museum tourguide robot. In: Fifteenth national conference on artificial intelligence, Madison, WI, July 1998, pp 11–18

    Google Scholar 

  2. Thrun S, Bennewitz M, Burgard W, Cremers AB, Dellaert F, Fox D, Hähnel D, Rosenberg CR, Roy N, Schulte J, Schulz D (1999) Minerva: a tour-guide robot that learns. In: 23rd annual German conference on artificial intelligence: advances in artificial intelligence, Pittsburgh, PA, September 1999, pp 14–26

    Google Scholar 

  3. Bauer A, Klasing K, Lidoris G, Mühlbauer Q, Rohrmüller F, Sosnowski S, Xu T, Kühnlen K, Wollherr D, Bus M (2009) The autonomous city explorer: towards natural human-robot interaction in urban environments. Int J Soc Robot 1(2):127–140

    Article  Google Scholar 

  4. Fod A, Howard A, Matarić MJ (2002) Laser-based people tracking. In: IEEE international conference on robotics and automation (ICRA), Washington, DC, May 2002, pp 3024–3029

    Google Scholar 

  5. Montemerlo M, Thrun S, Whittaker W (2002) Conditional particle filters for simultaneous mobile robot localization and people-tracking. In: IEEE international conference on robotics and automation (ICRA), Washington, DC, May 2002, pp 695–701

    Google Scholar 

  6. Xavier J, Pacheco M, Castro D, Ruano A, Nunes U (2005) Fast line, arc/circle and leg detection from laser scan data in a player driver. In: IEEE international conference on robotics and automation (ICRA), Barcelona, Spain, April 2005, pp 3941–3946

    Google Scholar 

  7. Cui J, Zha H, Zhao H, Shibasaki R (2006) Robust tracking of multiple people in crowds using laser range scanners. In: IEEE 18th international conference on pattern recognition (ICPR), Hong Kong, China, August 2006, pp 857–860

    Google Scholar 

  8. Lee JH, Tsubouchi T, Yamamoto K, Egawa S (2006) People tracking using a robot in motion with laser range finder. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Beijing, China, October 2006, pp 2936–2942

    Google Scholar 

  9. Zhao H, Chen Y, Shao X, Katabira K, Shibasaki R (2007) Monitoring a populated environment using single-row laser range scanners from a mobile platform. In: IEEE international conference on robotics and automation (ICRA), Roma, Italy, April 2007, pp 4739–4745

    Google Scholar 

  10. Arras KO, Martínez Mozos Ó, Burgard W (2007) Using boosted features for the detection of people in 2d range data. In: IEEE international conference on robotics and automation (ICRA), Roma, Italy, April 2007, pp 3402–3407

    Google Scholar 

  11. Schapire RE, Singer Y (1999) Improved boosting algorithms using confidence-rated predictions. Mach Learn 37(3):297–336

    Article  MATH  Google Scholar 

  12. Hashimoto M, Takahashi K, Matsui Y (2007) Moving-object tracking with multi-laser range sensors for mobile robot navigation. In: IEEE international conference on robotics and biomimetics (ROBIO), Sanya, China, December 2007, pp 399–404

    Chapter  Google Scholar 

  13. Gidel S, Checchin P, Blanc C, Chateau T, Trassoudaine L (2008) Pedestrian detection method using a multilayer laserscanner: Application in urban environment. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Nice, France, September 2008, pp 173–178

    Google Scholar 

  14. Martínez Mozos Ó, Kurazume R, Hasegawa T (2010) Multi-layer people detection using 2d range data. Int J Soc Robot 2(1):31–40

    Article  Google Scholar 

  15. Borges GA, Aldon M-J (2004) Line extraction in 2d range images for mobile robotics. J Intell Robot Syst 40:267–297

    Article  Google Scholar 

  16. Premebida C, Nunes U (2005) Segmentation and geometric primitives extraction from 2d laser range data for mobile robot applications. In: 5th national festival of robotics, scientific meeting (ROBOTICA), Coimbra, Portugal, April 2005, pp 17–25

    Google Scholar 

  17. Nguyen V, Gächter S, Martinelli A, Tomatis N, Siegwart R (2007) A comparison of line extraction algorithms using 2d range data for indoor mobile robotics. Auton Robots 23:97–111

    Article  Google Scholar 

  18. Mucientes M, Burgard W (2006) Multiple hypothesis tracking of clusters of people. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Beijing, China, October 2006, pp 692–697

    Google Scholar 

  19. Arras KO, Grzonka S, Luber M, Burgard W (2008) Efficient people tracking in laser range data using a multi-hypothesis leg-tracker with adaptive occlusion probabilities. In: IEEE international conference on robotics and automation (ICRA), Pasadena, CA, May 2008, pp 1710–1715

    Chapter  Google Scholar 

  20. Kondaxakis P, Kasderidis S, Trahanias PE (2008) A multi-target tracking technique for mobile robots using a laser range scanner. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Nice, France, September 2008, pp 3370–3377

    Google Scholar 

  21. Luber M, Tipaldi GD, Arras KO (2009) Spatially grounded multi-hypothesis tracking of people. In: Arras KO, Martínez Mozos Ó (eds) IEEE international conference on robotics and automation (ICRA) workshop on people detection and tracking, Kobe, Japan, May 2009, pp 73–80

    Google Scholar 

  22. Zivkovic Z, Kröse B (2007) Part based people detection using 2d range data and images. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), San Diego, CA, October 2007, pp 214–219

    Google Scholar 

  23. Carballo A, Ohya A, Yuta S (2008) Fusion of double layered multiple laser range finders for people detection from a mobile robot. In: IEEE international conference on multisensor fusion and integration for intelligent systems (MFI), Seoul, Korea, August 2008, pp 677–682

    Chapter  Google Scholar 

  24. Carballo A, Ohya A, Yuta S (2009) Multiple people detection from a mobile robot using double layered laser range finders. In: Arras KO, Martínez Mozos Ó (eds) IEEE international conference on robotics and automation (ICRA) workshop on people detection and Tracking, Kobe, Japan, May 2009, pp 94–100

    Google Scholar 

  25. Kawata H, Ohya A, Yuta S, Santosh W, Mori T (2005) Development of ultra-small lightweight optical range sensor system. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Edmonton, Canada, August 2005, pp 1078–1083

    Google Scholar 

  26. Pascoal J, Marques L, de Almeida AT (2008) Assessment of laser range finders in risky environments. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), Nice, France, September 2008, pp 3533–3538

    Google Scholar 

  27. Okubo Y, Ye C, Borenstein J (2009) Characterization of the Hokuyo urg-04lx laser rangefinder for mobile robot obstacle negotiation. In: SPIE conference on defense, security + sensing, unmanned systems technology XI: unmanned robotic and layered systems, vol 7332, Florida, USA, April 2009

    Google Scholar 

  28. Dietmayer KC, Sparbert J, Streller D (2001) Model based classification and object tracking in traffic scenes from range-images. In: IEEE intelligent vehicles symposium (IVS), Tokyo, Japan, May 2001

    Google Scholar 

  29. Klasing K, Wollherr D, Buss M (2009) Realtime segmentation of range data using continuous nearest neighbors. In: IEEE international conference on robotics and automation (ICRA), Kobe, Japan, May 2009, pp 4287–4292

    Google Scholar 

  30. Hancock J (1999) Laser intensity-based obstacle detection and tracking. PhD thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, January 1999

  31. Surmann H, Nüchter A, Hertzberg J (2003) An autonomous mobile robot with a 3d laser range finder for 3d exploration and digitalization of indoor environments. Robot Auton Syst 45(3-4):181–198

    Article  Google Scholar 

  32. Nüchter A, Surmann H, Hertzberg J (2005) Automatic classification of objects in 3d laser range scans. In: 8th conference on intelligent autonomous systems (IAS), Amsterdam, Netherlands, March 2005, pp 963–970

    Google Scholar 

  33. Montemerlo M, Becker J, Bhat S, Dahlkamp H, Dolgov D, Ettinger S, Hähnel D, Hilden T, Hoffmann G, Huhnke B, Johnston D, Klumpp S, Langer D, Levandowski A, Levinson J, Marcil J, Orenstein D, Paefgen J, Penny I, Petrovskaya A, Pflueger M, Stanek G, Stavens D, Vogt A, Thrun S (2008) Junior: the Stanford entry in the urban challenge. J Field Robot 25(9):569–597

    Article  MATH  Google Scholar 

  34. Ye C (2008) Mixed pixels removal of a laser rangefinder for mobile robot 3-d terrain mapping. In: IEEE international conference on information and automation (ICIA), Hunan, China, June 2008, pp. 1153–1158

    Google Scholar 

  35. Rusu RB, Meeussen W, Chitta S, Beetz M (2009) Laser-based perception for door and handle identification. In: IEEE international conference on advanced robotics (ICAR), Munich, Germany, June 2009, pp 1–8

    Google Scholar 

  36. Kawata H, Miyachi K, Hara Y, Ohya A, Yuta S (2008) A method for estimation of lightness of objects with intensity data from Sokuiki sensor. In: IEEE international conference on multisensor fusion and integration for intelligent systems (MFI), Seoul, Korea, August 2008, pp 661–664

    Chapter  Google Scholar 

  37. Haran T (2008) Short-wave infrared diffuse reflectance of textile materials. Master’s thesis, Physics and Astronomy, Georgia State University, Atlanta, GA, August 2008

  38. Franses PH (1994) Fitting a Gompertz curve. J Oper Res Soc 45(1):109–113

    MATH  Google Scholar 

  39. Jukić D, Kralik G, Scitovski R (2004) Least-squares fitting Gompertz curve. J Comput Appl Math 169:359–375

    Article  MathSciNet  MATH  Google Scholar 

  40. Adams MD (1993) Amplitude modulated optical range data analysis in mobile robotics. In: IEEE international conference on robotics and automation (ICRA), Georgia, USA, May 1993, vol 2, pp 8–13

    Google Scholar 

  41. Latt MD, Menz HB, Fung VS, Lord SR (2008) Walking speed, cadence and step length are selected to optimize the stability of head and pelvis acceleration. Exp Brain Res 184:201–209

    Article  Google Scholar 

  42. Luber M, Stork JA, Tipaldi GD, Arras KO, (2010) People tracking with human motion predictions from social forces. In: IEEE international conference on robotics and automation (ICRA), Alaska, USA, May 2010, pp 464–469

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Intelligent Robot Laboratory, Graduate School of Systems and Information Engineering, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba City, Ibaraki Pref., 305-8573, Japan

    Alexander Carballo, Akihisa Ohya & Shin’ichi Yuta

Authors
  1. Alexander Carballo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Akihisa Ohya
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shin’ichi Yuta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alexander Carballo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Carballo, A., Ohya, A. & Yuta, S. Reliable People Detection Using Range and Intensity Data from Multiple Layers of Laser Range Finders on a Mobile Robot. Int J of Soc Robotics 3, 167–186 (2011). https://doi.org/10.1007/s12369-010-0086-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-010-0086-3

Keywords

Search

Navigation