Skip to main content
SpringerLink
Log in

Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis

  • Original Paper
  • Published:
Journal of Big Data Analytics in Transportation Aims and scope Submit manuscript

Abstract

The rapid advancement in the field of deep learning and high performance computing has highly augmented the scope of video-based vehicle counting system. In this paper, the authors deploy several state-of-the-art object detection and tracking algorithms to detect and track different classes of vehicles in their regions of interest (ROI). The goal of correctly detecting and tracking vehicles’ in their ROI is to obtain an accurate vehicle count. Multiple combinations of object detection models coupled with different tracking systems are applied to access the best vehicle counting framework. The models’ addresses challenges associated to different weather conditions, occlusion and low-light settings and efficiently extracts vehicle information and trajectories through its computationally rich training and feedback cycles. The automatic vehicle counts resulting from all the model combinations are validated and compared against the manually counted ground truths of over 9 h’ traffic video data obtained from the Louisiana Department of Transportation and Development. Experimental results demonstrate that the combination of CenterNet and Deep SORT, and YOLOv4 and Deep SORT produced the best overall counting percentage for all vehicles.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig.1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Alp Güler R, Neverova N, Kokkinos I (2018) Densepose: Dense human pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7297–7306

  • Arteta C, Lempitsky V, Zisserman A (2016) Counting in the wild. In: European conference on computer vision, Springer, pp 483–498

  • Asha C, Narasimhadhan A (2018) Vehicle counting for traffic management system using YOLO and correlation filter. In: 2018 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), IEEE, pp 1–6

  • Awang S, Azmi NMAN (2018) Vehicle counting system based on vehicle type classification using deep learning method. In: IT Convergence and Security 2017. Springer, pp 52–59

  • Bewley A, Ge Z, Ott L, Ramos F, Upcroft B (2016) Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), IEEE, pp 3464–3468

  • Bochinski E, Senst T, Sikora T (2018) Extending IOU based multi-object tracking by visual information. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), IEEE, pp 1–6

  • Bochkovskiy A, Wang C-Y, Liao H-YM (2020) YOLOv4: optimal speed and accuracy of object detection arXiv preprint arXiv:200410934

  • Bui N, Yi H, Cho J (2020) A vehicle counts by class framework using distinguished regions tracking at multiple intersections. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 578–579

  • Cai Z, Vasconcelos N (2018) Cascade r-cnn: Delving into high quality object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6154–6162

  • Chakraborty P, Sharma A, Hegde C (2018) Freeway traffic incident detection from cameras: a semi-supervised learning approach. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), IEEE, pp 1840–1845

  • Chen Y-L, Wu B-F, Huang H-Y, Fan C-J (2010) A real-time vision system for nighttime vehicle detection and traffic surveillance. IEEE Trans Industr Electron 58:2030–2044

    Article  Google Scholar 

  • Chen Z, Ellis T, Velastin SA (2012) Vehicle detection, tracking and classification in urban traffic. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, IEEE, pp 951–956

  • Chou C-J, Chien J-T, Chen H-T (2018) Self adversarial training for human pose estimation. In: 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), IEEE, pp 17–30

  • Ciampi L, Amato G, Falchi F, Gennaro C, Rabitti F (2018) Counting Vehicles with Cameras. In: SEBD

  • Cucchiara R, Grana C, Piccardi M, Prati A (2000) Statistic and knowledge-based moving object detection in traffic scenes. In: ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No. 00TH8493), IEEE, pp 27–32

  • Dai Z, Song H, Wang X, Fang Y, Yun X, Zhang Z, Li H (2019) Video-based vehicle counting framework. IEEE Access 7:64460–64470

    Article  Google Scholar 

  • Duan K, Bai S, Xie L, Qi H, Huang Q, Tian Q (2019) Centernet: keypoint triplets for object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp 6569–6578

  • Hsieh M-R, Lin Y-L, Hsu WH (2017) Drone-based object counting by spatially regularized regional proposal network. In: Proceedings of the IEEE International Conference on Computer Vision, pp 4145–4153

  • Kalman RE (1960) A new approach to linear filtering and prediction problems

  • Khan G, Farooq MA, Tariq Z, Khan MUG (2019) Deep-Learning Based Vehicle Count and Free Parking Slot Detection System. In: 2019 22nd International Multitopic Conference (INMIC), IEEE, pp 1–7

  • Kirillov A, He K, Girshick R, Rother C, Dollár P (2019) Panoptic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9404–9413

  • Law H, Deng J (2018) Cornernet: detecting objects as paired keypoints. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 734–750

  • Lempitsky V, Zisserman A (2010) Learning to count objects in images. In: Advances in neural information processing systems, pp 1324–1332

  • Li Z, Shahidehpour M, Bahramirad S, Khodaei A (2016) Optimizing traffic signal settings in smart cities. IEEE Trans Smart Grid 8:2382–2393

    Article  Google Scholar 

  • Lin J-P, Sun M-T (2018) A YOLO-based traffic counting system. In: 2018 Conference on Technologies and Applications of Artificial Intelligence (TAAI), IEEE, pp 82–85

  • Liu F, Zeng Z, Jiang R (2017) A video-based real-time adaptive vehicle-counting system for urban roads. PLoS ONE 12:e0186098

    Article  Google Scholar 

  • Milan A, Leal-Taixé L, Reid I, Roth S, Schindler K (2016) MOT16: a benchmark for multi-object tracking arXiv preprint arXiv:160300831

  • Misra D (2019) Mish: a self regularized non-monotonic neural activation function arXiv preprint arXiv:190808681

  • Mo G, Zhang S (2010) Vehicles detection in traffic flow. In: 2010 Sixth International Conference on Natural Computation, IEEE, pp 751–754

  • Mundhenk TN, Konjevod G, Sakla WA, Boakye K (2016) A large contextual dataset for classification, detection and counting of cars with deep learning. In: European Conference on Computer Vision, Springer, pp 785–800

  • Onoro-Rubio D, López-Sastre RJ (2016) Towards perspective-free object counting with deep learning. In: European Conference on Computer Vision, Springer, pp 615–629

  • Pang CCC, Lam WWL, Yung NHC (2007) A method for vehicle count in the presence of multiple-vehicle occlusions in traffic images. IEEE Trans Intell Transp Syst 8:441–459

    Article  Google Scholar 

  • Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788

  • Shen F, Gan R, Zeng G (2016) Weighted residuals for very deep networks. In: 2016 3rd International Conference on Systems and Informatics (ICSAI), IEEE, pp 936–941

  • Sindagi VA, Patel VM (2018) A survey of recent advances in cnn-based single image crowd counting and density estimation. Pattern Recogn Lett 107:3–16

    Article  Google Scholar 

  • SuganyaDevi K, Malmurugan N, Sivakumar R (2012) Efficient foreground extraction based on optical flow and smed for road traffic analysis. Int J Cyber-Security Digital Forensics (IJCSDF) 1:177–182

    Google Scholar 

  • Tan M, Pang R, Le QV (2020) Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 10781–10790

  • Toropov E, Gui L, Zhang S, Kottur S, Moura JM (2015) Traffic flow from a low frame rate city camera. In: 2015 IEEE International Conference on Image Processing (ICIP), IEEE, pp 3802–3806

  • Tsai C-M, Yeh Z-M (2013) Intelligent moving objects detection via adaptive frame differencing method. In: Asian Conference on Intelligent Information and Database Systems, 2013. Springer, pp 1–11

  • Wang C-Y, Mark Liao H-Y, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H (2020) CSPNet: a new backbone that can enhance learning capability of cnn. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 390–391

  • Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. In: 2017 IEEE international conference on image processing (ICIP), IEEE, pp 3645–3649

  • Wu Y, Kirillov A, Massa F, Lo W-Y, Girshick R (2019) Detectron2

  • Yao Z, Cao Y, Zheng S, Huang G, Lin S (2020) Cross-iteration batch normalization arXiv preprint arXiv:200205712

  • Zhang C, Li H, Wang X, Yang X (2015) Cross-scene crowd counting via deep convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 833–841

  • Zhang Y, Zhou D, Chen S, Gao S, Ma Y (2016) Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 589–597

  • Zhang S, Wu G, Costeira JP, Moura JM (2017) Fcn-rlstm: deep spatio-temporal neural networks for vehicle counting in city cameras. In: Proceedings of the IEEE international conference on computer vision, pp 3667–3676

  • Zhao Z, Li H, Zhao R, Wang X (2016) Crossing-line crowd counting with two-phase deep neural networks. In: European Conference on Computer Vision, Springer, pp 712–726

  • Zheng Y, Peng S (2012) Model based vehicle localization for urban traffic surveillance using image gradient based matching. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, IEEE, pp 945–950

Download references

Author information

Authors and Affiliations

  1. Department of Civil and Environmental Engineering, University of Missouri-Columbia, W1024 Lafferre Hall, Columbia, MO, 65211, USA

    Vishal Mandal & Yaw Adu-Gyamfi

  2. WSP USA, 211 N Broadway #2800, St. Louis, MO, 63102, USA

    Vishal Mandal

Authors
  1. Vishal Mandal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yaw Adu-Gyamfi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vishal Mandal.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mandal, V., Adu-Gyamfi, Y. Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis. J. Big Data Anal. Transp. 2, 251–261 (2020). https://doi.org/10.1007/s42421-020-00025-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42421-020-00025-w

Keywords

Search

Navigation