Skip to main content
SpringerLink
Log in

Multipoint infrared laser-based detection and tracking for people counting

  • S.I. : Neural Computing in Next Generation Virtual Reality Technology
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Laser devices have received increasing attention in numerous computer-aided applications such as automatic control, 3D modeling and virtual reality. In this paper, aiming at people counting, we propose a novel people detection and tracking method based on the multipoint infrared laser, which can further facilitate intelligent scene modeling and analysis. In our method, a camera with the infrared lens filter is utilized to capture the monitored scene where an array of infrared spots is produced by the multipoint infrared laser. We build a spatial background model based on locations of spots. Pedestrians are detected by clustering of foreground spots. Then, our method tracks and counts the detected pedestrians via inferring the forward–backward motion consistency. Both quantitative and qualitative evaluation and comparison are conducted, and the experimental results demonstrate that the proposed method achieves excellent performance in challenging scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Almomani R, Dong M, Zhu D (2017) Object tracking via Dirichlet process-based appearance models. Neural Comput Appl 28(5):867–879

    Article  Google Scholar 

  2. Antonini G, Thiran JP (2006) Counting pedestrians in video sequences using trajectory clustering. IEEE Trans Circuits Syst Video Technol 16(8):1008–1020

    Article  Google Scholar 

  3. Bertozzi M, Broggi A, Caraffi C, Rose MD, Felisa M, Vezzoni G (2007) Pedestrian detection by means of far-infrared stereo vision. Comput Vis Image Underst 106(2–3):194–204

    Article  Google Scholar 

  4. Breitenstein M, Reichlin F, Leibe B, Koller-Meier E, Gool LV (2009) Robust tracking-by-detection using a detector confidence particle filter. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 1515–1522

  5. Brostow GJ, Cipolla R (2006) Unsupervised Bayesian detection of independent motion in crowds. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 594–601

  6. Chan AB, Liang ZJ, Vasconcelos N (2008) Privacy preserving crowd monitoring: counting people without people models or tracking. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 1–7

  7. Chen K, Kamarainen JK (2014) Learning to count with back-propagated information. In: Proceedings of international conference on pattern recognition, pp 4672–4677

  8. Cong Y, Gong H, Zhu SC, Tang Y (2009) Flow mosaicking: Real-time pedestrian counting without scene-specific learning. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 1093–1100

  9. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 886–893

  10. Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761

    Article  Google Scholar 

  11. Dong L, Parameswaran V, Ramesh V, Zoghlami I (2007) Fast crowd segmentation using shape indexing. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 1–8

  12. Fardi B, Schuenert U, Wanielik G (2005) Shape and motion-based pedestrian detection in infrared images: a multi sensor approach. In: Proceedings of IEEE intelligent vehicles symposium, pp 18–23

  13. Felzenszwalb P, Girshick R, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627–1645

    Article  Google Scholar 

  14. Fod A, Howard A, Mataric MAJ (2002) A laser-based people tracker. In: Proceedings of ieee international conference on robotics and automation (ICRA), pp. 3024–3029

  15. Gavrila DM (1999) The visual analysis of human movement: a survey. Comput Vis Image Underst 73(1):82–89

    Article  MATH  Google Scholar 

  16. Hashimoto M, Konda T, Bai Z, Takahashi K (2010) Identification and tracking using laser and vision of people maneuvering in crowded environments. In: Proceedings of IEEE international conference on systems man and cybernetics, pp 3145–3151

  17. Johansson A, Helbing D, Shukla P (2007) Specification of the social force pedestrian model by evolutionary adjustment to video tracking data. Adv Complex Syst 10(2):271–288

    Article  MathSciNet  MATH  Google Scholar 

  18. Kocak YP, Sevgen S (2017) Detecting and counting people using real-time directional algorithms implemented by compute unified device architecture. Neurocomputing 248:105–111

    Article  Google Scholar 

  19. Kong D, Gray D, Tao H (2006) A viewpoint invariant approach for crowd counting. In: Proceedings of international conference on pattern recognition, pp 1187–1190

  20. Kuo JY, Fan GD, Lai TY (2017) People counting base on head and shoulder information. In: Proceedings of IEEE international conference on knowledge engineering and applications, pp 52–55

  21. Lee GG, Kim HK, Yoon JY, Kim JJ, Kim WY (2008) Pedestrian counting using an IR line laser. In: Proceedings of international conference on convergence and hybrid information technology, pp 482–485

  22. Li C, Cheng H, Hu S, Liu X, Tang J, Lin L (2016) Learning collaborative sparse representation for grayscale-thermal tracking. IEEE Trans Image Process 25(12):5743–5756

    Article  MathSciNet  Google Scholar 

  23. Li Y, Zhu E, Zhu X, Yin J, Zhao J (2014) Counting pedestrian with mixed features and extreme learning machine. Cognit Comput 6(3):462–476

    Article  Google Scholar 

  24. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of international joint conference on artificial intelligence (IJCAI), pp 285–289

  25. Maddalena L, Petrosino A, Russo F (2014) People counting by learning their appearance in a multi-view camera environment. Pattern Recogn Lett 36(36):125–134

    Article  Google Scholar 

  26. Marana A, Costa L, Lotufo R, Velastin S (1999) Estimating crowd density with Minkowski fractal dimension. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing, pp 3521–3524

  27. Marana A, Costa LD, Lotufo R, Velastin S (1998) On the efficacy of texture analysis for crowd monitoring. In: Proceedings of international symposium on computer graphics, image processing, and vision, pp 354–361

  28. Marana A, Velastin S, Costa L, Lotufo R (1998) Automatic estimation of crowd density using texture. Saf Sci 28(3):165–175

    Article  Google Scholar 

  29. Meng F, Qi Z, Tian Y, Niu L (2016) Pedestrian detection based on the privileged information. Neural Comput Appl online:1–10

    Google Scholar 

  30. Nanda H, Davis L (2002) Probabilistic template based pedestrian detection in infrared videos. In: Proceedings of IEEE intelligent vehicle symposium, vol 1. pp 15–20

  31. Pellegrini S, Ess A, Schindler K, Gool LV (2009) You’ll never walk alone: modeling social behavior for multi-target tracking. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 261–268

  32. Pizzo LD, Foggia P, Greco A, Percannella G, Vento M (2016) Counting people by RGB or depth overhead cameras. Pattern Recogn Lett 81:41–50

    Article  Google Scholar 

  33. Rodriguez M, Laptev I, Sivic J, Audibert JY (2011) Density-aware person detection and tracking in crowds. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 2423–2430

  34. Shao X, Zhao H, Nakamura K, Katabira K, Shibasaki R, Nakagawa Y (2007) Detection and tracking of multiple pedestrians by using laser range scanners. In: Proceedings of international conference on intelligent robots and systems, pp 2174–2179

  35. Shi J, Tomasi C (1994) Good features to track. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 593–600

  36. Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304

    Article  Google Scholar 

  37. Vera P, Monjaraz S, Salas J (2016) Counting pedestrians with a zenithal arrangement of depth cameras. Mach Vis Appl 27(2):303–315

    Article  Google Scholar 

  38. Viola P, Jones M, Snow D (2005) Detecting pedestrians using patterns of motion and appearance. Int J Comput Vision 63(2):153–161

    Article  Google Scholar 

  39. Wang Y, Lian H, Chen P, Lu Z (2014) Counting people with support vector regression. In: Proceedings of international conference on natural computation, pp 139–143

  40. Wu B, Nevatia R (2005) Detection of multiple, partially occluded humans in a single image by Bayesian combination of edgelet part detectors. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 90–97

  41. Xia W, Zhang J, Kruger U (2015) Semisupervised pedestrian counting with temporal and spatial consistencies. IEEE Trans Intell Transp Syst 16(4):1705–1715

    Article  Google Scholar 

  42. Xu F, Liu X, Fujimura K (2005) Pedestrian detection and tracking with night vision. IEEE Trans Intell Transp Syst 6(1):63–71

    Article  Google Scholar 

  43. Zhang C, Li H, Wang X, Yang X (2015) Cross-scene crowd counting via deep convolutional neural networks. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 833–841

  44. Zhang Y, Zhou D, Chen S, Gao S, Ma Y (2016) Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 589–597

  45. Zhao H, Shibasaki R (2005) A novel system for tracking pedestrians using multiple single-row laser-range scanners. IEEE Trans Syst Man Cybern Part A Syst Hum 35(2):283–291

    Article  Google Scholar 

  46. Zhuang J, Liu Q (2016) Transferred IR pedestrian detector toward distinct scenarios adaptation. Neural Comput Appl 27(3):557–569

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Weina Jiang and Hengzheng Zhu who partly joined this work when they were postgraduate students at Sun Yat-sen University, and thank the editors and reviewers for their valuable suggestions on improving the quality of the paper.

Author information

Authors and Affiliations

  1. Guangdong University of Foreign Studies, Guangzhou, China

    Hefeng Wu

  2. Sun Yat-sen University, Guangzhou, China

    Hefeng Wu, Chengying Gao, Yirui Cui & Ruomei Wang

Authors
  1. Hefeng Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chengying Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yirui Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ruomei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chengying Gao.

Ethics declarations

Conflict of interest

All the authors declare that they have no conflict of interests.

Additional information

This work was supported by the National Natural Science Foundation of China (61402120, 61472455, 61379112), the Natural Science Foundation of Guangdong Province (2014A030310348 and 2014A030313154), and Guangdong Provincial Department of Science and Technology (GDST16EG04) 2016A050503024.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, H., Gao, C., Cui, Y. et al. Multipoint infrared laser-based detection and tracking for people counting. Neural Comput & Applic 29, 1405–1416 (2018). https://doi.org/10.1007/s00521-017-3196-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-3196-0

Keywords

Search

Navigation