Encyclopedia of Robotics

Living Edition
| Editors: Marcelo H Ang, Oussama Khatib, Bruno Siciliano

Human Detection and Tracking

  • Nicola BellottoEmail author
  • Serhan Cosar
  • Zhi Yan
Living reference work entry
DOI: https://doi.org/10.1007/978-3-642-41610-1_34-1

Synonyms

Definition

The act of observing and estimating human locomotion with one or more robot sensors.

Overview

In robotics, detecting and tracking moving objects is key to implementing useful and safe robot behaviors. Identifying which of the detected objects are humans is particularly important for domestic and public environments. Typically the robot is required to collect environmental data of the surrounding area using its onboard sensors, estimating where humans are and where they are going to. Moreover, robots should detect and track humans accurately and as early as possible in order to have enough time to react accordingly.

The following sections present the topic from different perspectives, analyzing the two complementary problems of human detection and trackingseparately and differentiating various techniques by the type of sensors and algorithms used for these tasks. In particular, human detection considers the sensors and the...
This is a preview of subscription content, log in to check access.

References

  1. Arras KO, Mozos OM, Burgard W (2007) Using boosted features for the detection of people in 2D range data. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 3402–3407Google Scholar
  2. Bar-Shalom Y, Li XR (1995) Multitarget-multisensor tracking: principles and techniques. Y. Bar-Shalom, StorrsGoogle Scholar
  3. Bar-Shalom Y, Li XR, Kirubarajan T (2004) Estimation with applications to tracking and navigation: theory algorithms and software. Wiley, New YorkGoogle Scholar
  4. Bellotto N, Hu H (2009) Multisensor-based human detection and tracking for mobile service robots. IEEE Trans Syst Man Cybern B Cybern 39(1):167–181Google Scholar
  5. Bellotto N, Hu H (2010) Computationally efficient solutions for tracking people with a mobile robot: an experimental evaluation of Bayesian filters. Auton Robot 28(4):425–438Google Scholar
  6. Bellotto N, Fernandez-Carmona M, Cosar S (2017) ENRICHME Integration of Ambient Intelligence and Robotics for AAL. In: AAAI Spring Symposium Series.Google Scholar
  7. Bennewitz M, Burgard W, Cielniak G, Thrun S (2005) Learning motion patterns of people for compliant robot motion. Int J Robot Res 24(1):31–48Google Scholar
  8. Buhmann J, Burgard W, Cremers AB, Fox D, Hofmann T, Schneider FE, Strikos J, Thrun S (1995) The mobile robot RHINO. AI Mag 16(2):31–38Google Scholar
  9. Cielniak G, Duckett T, Lilienthal AJ (2010) Data association and occlusion handling for vision-based people tracking by mobile robots. Robot Auton Syst 58(5):435–443Google Scholar
  10. Cosgun A, Florencio DA, Christensen HI (2013) Autonomous person following for telepresence robots. In: Proceedings of IEEE international conference on robotics and automation (ICRA), May 2013, pp 4335–4342Google Scholar
  11. Dequaire J, Ondrúška P, Rao D, Wang D, Posner I (2017) Deep tracking in the wild: end-to-end tracking using recurrent neural networks. Int J Robot Res 37(4–5): 492–512Google Scholar
  12. Dewan A, Caselitz T, Tipaldi GD, Burgard W (2016) Motion-based detection and tracking in 3D LiDAR scans. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 4508–4513Google Scholar
  13. Ess A, Leibe B, Schindler K, Van Gool LJ (2009) Moving obstacle detection in highly dynamic scenes. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 56–63Google Scholar
  14. Ess A, Schindler K, Leibe B, Van Gool L (2010) Object detection and tracking for autonomous navigation in dynamic environments. Int J Robot Res (IJRR) 29(14):1707–1725Google Scholar
  15. Falanga D, Mueggler E, Faessler M, Scaramuzza D (2017) Aggressive quadrotor flight through narrow gaps with onboard sensing and computing using active vision. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5774–5781Google Scholar
  16. Fernández-Caballero A, Castillo JC, Martínez-Cantos J, Martínez-Toms R (2010) Optical flow or image subtraction in human detection from infrared camera on mobile robot. Robot Auton Syst 58(12):1273–1281Google Scholar
  17. Germa T, Lerasle F, Ouadah N, Cadenat V (2010) Vision and RFID data fusion for tracking people in crowds by a mobile robot. Comput Vis Image Underst 114(6):641–651Google Scholar
  18. Gockley R, Forlizzi J, Simmons R (2007) Natural person-following behavior for social robots. In: 2007 2nd ACM/IEEE international conference on human-robot interaction (HRI), Mar 2007, pp 17–24Google Scholar
  19. González A, Villalonga G, Xu J, Vázquez D, Amores J, López AM (2015) Multiview random forest of local experts combining RGB and LIDAR data for pedestrian detection. In: Proceedings of IEEE intelligent vehicles symposium (IV), pp 356–361Google Scholar
  20. Gritti AP, Tarabini O, Guzzi J, Di Caro GA, Caglioti V, Gambardella LM, Giusti A (2014) Kinect-based people detection and tracking from small-footprint ground robots. In: Proceedings of the 2014 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 4096–4103Google Scholar
  21. Haasch A, Hohenner S, Hüwel S, Kleinehagenbrock M, Lang S, Toptsis I, Fink GA, Fritsch J, Wrede B, Sagerer G (2004) BIRON – the Bielefeld robot companion. In: Prassler E, Lawitzky G, Fiorini P, Hägele M (eds) Proceedings of international workshop on advances in service robotics, pp 27–32. Fraunhofer IRB Verlag, StuttgartGoogle Scholar
  22. Jafari OH, Mitzel D, Leibe B (2014) Real-time RGB-D based people detection and tracking for mobile robots and head-worn cameras. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5636–5643Google Scholar
  23. Kaestner R, Maye J, Pilat Y, Siegwart R (2012) Generative object detection and tracking in 3D range data. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 3075–3081Google Scholar
  24. Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34:1409–1422Google Scholar
  25. Kidono K, Miyasaka T, Watanabe A, Naito T, Miura J (2011) Pedestrian recognition using high-definition LIDAR. In: Proceedings of the 2011 IEEE intelligent vehicles symposium (IV), pp 405–410Google Scholar
  26. Kobilarov M, Sukhatme G, Hyams J, Batavia P (2006) People tracking and following with mobile robot using an omnidirectional camera and a laser. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 557–562Google Scholar
  27. Li K, Wang X, Xu Y, Wang J (2016) Density enhancement-based long-range pedestrian detection using 3-D range data. IEEE Trans Intell Transp Syst 17:1368–1380Google Scholar
  28. Linder T, Arras KO (2014) Multi-model hypothesis tracking of groups of people in RGB-D data. In: 17th international conference on information fusion (FUSION), pp 1–7Google Scholar
  29. Linder T, Breuers S, Leibe B, Arras KO (2016) On multi-modal people tracking from mobile platforms in very crowded and dynamic environments. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5512–5519Google Scholar
  30. Montabone S, Soto A (2010) Human detection using a mobile platform and novel features derived from a visual saliency mechanism. Image Vis Comput 28(3):391–402Google Scholar
  31. Munaro M, Menegatti E (2014) Fast RGB-D people tracking for service robots. Auton Robot 37:227–242Google Scholar
  32. Navarro-Serment LE, Mertz C, Hebert M (2010) Pedestrian detection and tracking using three-dimensional ladar data. Int J Robot Res 29(12):1516–1528Google Scholar
  33. Premebida C, Carreira J, Batista J, Nunes U (2014) Pedestrian detection combining RGB and dense LIDAR data. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 4112–4117Google Scholar
  34. Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter: particle filters for tracking applications. Artech House, BostonGoogle Scholar
  35. Schroeter C, Mueller S, Volkhardt M, Einhorn E, Huijnen C, van den Heuvel H, van Berlo A, Bley A, Gross HM (2013) Realization and user evaluation of a companion robot for people with mild cognitive impairments. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 1153–1159Google Scholar
  36. Schulz D, Burgard W, Fox D, Cremers AB (2003) People tracking with mobile robots using sample-based joint probabilistic data association filters. Int J Robot Res 22(2):99–116Google Scholar
  37. Spinello L, Arras KO (2011) People detection in RGB-D data. In: Proceedings of the 2011 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 3838–3843Google Scholar
  38. Spinello L, Luber M, Arras KO (2011) Tracking people in 3D using a bottom-up top-down detector. In: Proceedings of the 2011 IEEE international conference on robotics and automation (ICRA), pp 1304–1310Google Scholar
  39. Stone LD, Barlow CA, Corwin TL (1999) Bayesian multiple target tracking. Artech House Publishers, BostonGoogle Scholar
  40. Teichman A, Levinson J, Thrun S (2011) Towards 3D object recognition via classification of arbitrary object tracks. In: Proceedings of the 2011 IEEE international conference on robotics and automation (ICRA), pp 4034–4041Google Scholar
  41. Topp EA, Christensen HI (2005) Tracking for following and passing persons. In: 2005 IEEE/RSJ international conference on intelligent robots and systems, pp 2321–2327Google Scholar
  42. Treptow A, Cielniak G, Duckett T (2006) Real-time people tracking for mobile robots using thermal vision. Robot Auton Syst 54(9):729–739Google Scholar
  43. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154Google Scholar
  44. Wang CC, Thorpe C (2002) Simultaneous localization and mapping with detection and tracking of moving objects. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 2918–2924Google Scholar
  45. Wang DZ, Posner I, Newman P (2015) Model-free detection and tracking of dynamic objects with 2D lidar. Int J Robot Res (IJRR) 34(7):1039–1063Google Scholar
  46. Yan Z, Duckett T, Bellotto N (2017) Online learning for human classification in 3D lidar-based tracking. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 864–871Google Scholar
  47. Zajdel W, Zivkovic Z, Krŏse BJA (2005) Keeping track of humans: have I seen this person before? In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 2093–2098Google Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Computer ScienceUniversity of LincolnLincolnUK
  2. 2.LE2I-CNRSUniversity of Technology of Belfort-Montbeliard (UTBM)BelfortFrance

Section editors and affiliations

  • Jee-Hwan Ryu
    • 1
  1. 1.School of Mechanical EngineeringKorea University of Technology & EducationCheon-AnRepublic of Korea