Skip to main content
SpringerLink
Log in

Smart junction: advanced zone-based traffic control system with integrated anomaly detector

  • Original Research
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

Traffic control through video/image processing is a trending research topic within Intelligent Transportation Systems. The number of moving vehicles, the density of vehicles at the junctions, traffic anomalies, and traffic flow directly influence real-time traffic congestion. The primary goal of this work is to design an architecture that is simple and fast enough to use in real-time heterogeneous traffic scenes. The proposed methodology uses user-defined zones for determining vehicle occupancy and count based on traffic surveillance video. The angular integral projection function accompanies the background subtraction method for better localization. Traffic anomaly detection is implemented by incorporating intelligent sensor technology. Also, the skipping of frames at fixed intervals has increased the processing speed with minimal data loss. The compatibility with any Internet Protocol camera further distinguishes this approach from other state-of-the-art methods. The proposed algorithm has been tested on a publicly available traffic surveillance video dataset and real-time surveillance feeds. Experimental results from the real-time intersection scenes show an overall accuracy of 97.14% and an average processing speed of 92.91%. The accuracy of the detection module in the custom-made dataset is 98.73%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The dataset generated and analyzed during the current study are not publicly available because they are custom-made primary dataset of the observation area but are available from the corresponding author on reasonable request.

References

  • Abdelwahab, MA. (2019) Accurate vehicle counting approach based on deep neural networks. In 2019 International conference on innovative trends in computer engineering (ITCE). (pp. 1–5). IEEE

  • Alessandretti, G., Broggi, A., & Cerri, P. (2007). Vehicle and guard rail detection using radar and vision data fusion. IEEE Transactions on Intelligent Transportation Systems, 8(1), 95–105.

    Article  Google Scholar 

  • Anbaroğlu, B., Cheng, T., & Heydecker, B. (2015). Non-recurrent traffic congestion detection on heterogeneous urban road networks. Transportmetrica A: Transport Science, 11(9), 754–771.

    Article  Google Scholar 

  • Aradhya, HR. et al (2020). Performance evaluation of background modeling methods for object detection and tracking. In 2020 Fourth international conference on inventive systems and control (ICISC) (pp. 413–420). IEEE

  • Bochkovskiy, A., Wang, CY., & Liao, HYM. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934

  • Bouaich, S., Mahraz, MA., & Riffı J, et al. (2018). Vehicle counting system in real-time. In: 2018 International conference on intelligent systems and computer vision (ISCV) (pp. 1–4). IEEE

  • Carion, N., Massa, F., & Synnaeve, G. et al. (2020). End-to-end object detection with transformers. In European conference on computer vision (pp. 213–229). Springer

  • Chandan, G., Jain, A., & Jain, H. et al (2018). Real time object detection and tracking using deep learning and opencv. In 2018 International Conference on inventive research in computing applications (ICIRCA) (pp. 1305–1308). IEEE

  • Chen, Y., & Hu, W. (2020). Robust vehicle detection and counting algorithm adapted to complex traffic environments with sudden illumination changes and shadows. Sensors, 20(9), 2686.

    Article  Google Scholar 

  • Chen, B., & Yang, X. (2022). Small obstacles image detection and classification for driver assistance. Multimedia Tools and Applications, 81(21), 30,785-30,795.

    Article  Google Scholar 

  • Chen, L., Zhang, Z., & Peng, L. (2018). Fast single shot multibox detector and its application on vehicle counting system. IET Intelligent Transport Systems, 12(10), 1406–1413.

    Article  Google Scholar 

  • Dewi, C., Chen, R. C., Liu, Y. T., et al. (2021). Yolo v4 for advanced traffic sign recognition with synthetic training data generated by various gan. IEEE Access, 9, 97,228-97,242. https://doi.org/10.1109/ACCESS.2021.3094201

    Article  Google Scholar 

  • Dhiyanesh, B., Rajkumar, S., & Radha, R., et al. (2021). Improved object detection in video surveillance using deep convolutional neural network learning. In 2021 Fifth international conference on I-SMAC (IoT in Social (pp. 1–8). Analytics and Cloud)(I-SMAC). IEEE, Mobile

  • Engel, J. I., Martin, J., & Barco, R. (2016). A low-complexity vision-based system for real-time traffic monitoring. IEEE Transactions on Intelligent Transportation Systems, 18(5), 1279–1288.

    Article  Google Scholar 

  • Girshick, R. (2015). Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision (pp. 1440–1448)

  • Girshick, R., Donahue, J., & Darrell, T., et al. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580–587)

  • Gomaa, A., Minematsu, T., Abdelwahab, M. M., et al. (2022). Faster CNN-based vehicle detection and counting strategy for fixed camera scenes. Multimedia Tools and Applications, 81(18), 25,443-25,471.

    Article  Google Scholar 

  • Guerrero-Gómez-Olmedo, R., López-Sastre, RJ., & Maldonado-Bascón, S. et al (2013). Vehicle tracking by simultaneous detection and viewpoint estimation. In International work-conference on the interplay between natural and artificial Computation (pp. 306–316). Springer

  • Guo, J., He, H., He, T., et al. (2020). Gluoncv and gluonnlp: Deep learning in computer vision and natural language processing. The Journal of Machine Learning Research, 21(1), 845–851.

    Google Scholar 

  • Hong, F., Lu, Ch., Tao, W., et al. (2022). Improved SSD model for pedestrian detection in natural scene. Wireless Communications and Mobile Computing. https://doi.org/10.1155/2022/1500428

    Article  Google Scholar 

  • Hossain, M. A., Nguyen, V., & Huh, E. N. (2021). The trade-off between accuracy and the complexity of real-time background subtraction. IET Image Processing, 15(2), 350–368.

    Article  Google Scholar 

  • Jain, N., Yerragolla, S., & Guha, T., et al. (2019). Performance analysis of object detection and tracking algorithms for traffic surveillance applications using neural networks. In 2019 Third International conference on I-SMAC (IoT in Social Analytics and Cloud) (pp. 690–696). (I-SMAC), IEEE: Mobile.

  • Jo, Y., & Jung, I. (2014). Analysis of vehicle detection with wsn-based ultrasonic sensors. Sensors, 14(8), 14,050-14,069.

    Article  Google Scholar 

  • Kamkar, S., & Safabakhsh, R. (2016). Vehicle detection, counting and classification in various conditions. IET Intelligent Transport Systems, 10(6), 406–413.

    Article  Google Scholar 

  • Karpathy, A., Toderici, G., & Shetty, S., et al. (2014). Large-scale video classification with convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1725–1732.

  • Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 1097–1105.

    Google Scholar 

  • LeCun, Y., Boser, BE., & Denker, JS. et al. (1990). Handwritten digit recognition with a back-propagation network. In: Advances in neural information processing systems (pp. 396–404)

  • Li, L., Lin, Y., Du, B., et al. (2022). Real-time traffic incident detection based on a hybrid deep learning model. Transportmetrica A: Transport Science, 18(1), 78–98.

    Article  Google Scholar 

  • Li, J., Mei, X., Prokhorov, D., et al. (2016). Deep neural network for structural prediction and lane detection in traffic scene. IEEE Transactions on Neural Networks and Learning Systems, 28(3), 690–703.

    Article  Google Scholar 

  • Li, D. L., Prasad, M., Liu, C. L., et al. (2020). Multi-view vehicle detection based on fusion part model with active learning. IEEE Transactions on Intelligent Transportation Systems, 22(5), 3146–3157.

    Article  Google Scholar 

  • Liu, W., Anguelov, D., & Erhan, D. et al (2016). Ssd: Single shot multibox detector. In European conference on computer vision (pp. 21–37). Springer

  • Liu, F., Zeng, Z., & Jiang, R. (2017). A video-based real-time adaptive vehicle-counting system for urban roads. PloS One, 12(11), e0186,098.

    Article  Google Scholar 

  • Mohammed, G. J., Hong, B. R., & Jarjes, A. A. (2010). Accurate pupil features extraction based on new projection function. Computing and Informatics, 29(4), 663.

    Google Scholar 

  • Otsu, N. (1979). A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics, 9(1), 62–66.

    Article  Google Scholar 

  • Parsola, J., Gangodkar, D., & Mittal, A. (2021). Automated system for road extraction and traffic volume estimation for traffic jam detection. International Journal of Computational Vision and Robotics, 11(2), 127–150.

    Article  Google Scholar 

  • Perttunen, M., Kostakos, V., Riekki, J., et al. (2015). Urban traffic analysis through multi-modal sensing. Personal and Ubiquitous Computing, 19(3), 709–721.

    Article  Google Scholar 

  • Quesada, J., & Rodriguez, P. (2016). Automatic vehicle counting method based on principal component pursuit background modeling. In: 2016 IEEE International conference on image processing (ICIP) (pp. 3822–3826). IEEE

  • Rabbouch, H., Saâdaoui, F., & Mraihi, R. (2017). Unsupervised video summarization using cluster analysis for automatic vehicles counting and recognizing. Neurocomputing, 260, 157–173.

    Article  Google Scholar 

  • RaviKrishna, B., Priya, KS., & Harika, J. et al. (2021). Comprehensive cnn-based approach for helmet use detection of tracked motor cycles. In 2021 4th International Conference on Recent Developments in Control, Automation & Power Engineering (RDCAPE) (pp. 510–514). IEEE

  • Redmon, J., & Farhadi, A. (2017). Yolo9000: Better, faster, stronger. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263–7271.

  • Redmon, J., & Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767

  • Redmon, J., Divvala, S., & Girshick, R., et al. (2016). You only look once: Unified, real-time object detection. InProceedings of the IEEE conference on computer vision and pattern recognition (pp. 779–788)

  • Ren, S., He, K., & Girshick, R. et al. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497

  • Ren, S., He, K., & Girshick, R. et al. (2015). Towards real-time object detection with region proposal networks. corr. arXiv preprint arXiv:1506.01497

  • Satyanarayana, G., Majhi, S., & Das, S. K. (2021). A vehicle detection technique using binary images for heterogeneous and lane-less traffic. IEEE Transactions on Instrumentation and Measurement, 70, 1–14.

    Article  Google Scholar 

  • Seenouvong, N., Watchareeruetai, U., & Nuthong, C. et al (2016). A computer vision based vehicle detection and counting system. In: 2016 8th International conference on knowledge and smart technology (KST) (pp. 224–227). IEEE

  • Shen, J., Tao, D., & Li, X. (2008). Modality mixture projections for semantic video event detection. IEEE Transactions on Circuits and Systems for Video Technology, 18(11), 1587–1596.

    Article  Google Scholar 

  • Subedi, R., Shrestha, P., Pujari, M., et al. (2022). Vehicle classification, rumble strips detection, and mapping using artificial intelligence. In International conference on transportation and development, 2022, (pp. 46–56).

  • Sukkar, M., Kumar, D., & Sindha, J. (2021). Real-time pedestrians detection by yolov5. In 2021 12th international conference on computing communication and networking technologies (ICCCNT) (pp. 01–06). IEEE

  • Tourani, A., & Shahbahrami, A. (2015). Vehicle counting method based on digital image processing algorithms. In: 2015 2nd International conference on pattern recognition and image analysis (IPRIA) (pp. 1–6). IEEE

  • Uijlings, J. R., Van De Sande, K. E., Gevers, T., et al. (2013). Selective search for object recognition. International Journal of Computer Vision, 104(2), 154–171.

    Article  Google Scholar 

  • Venkatesh, H., Perur, S. D., & Jagadish, M. (2015). An approach to make way for intelligent ambulance using IoT. International Journal of Electrical and Electronics Research, 3(1), 218–223.

    Google Scholar 

  • Wang, P., Lai, J., Huang, Z., et al. (2020). Estimating traffic flow in large road networks based on multi-source traffic data. IEEE Transactions on Intelligent Transportation Systems, 22(9), 5672–5683.

  • Wu, C. F., Lin, C. J., & Lee, C. Y. (2011). Applying a functional neurofuzzy network to real-time lane detection and front-vehicle distance measurement. IEEE Transactions on Systems, Man, and Cybernetics Part C (Applications and Reviews), 42(4), 577–589.

    Google Scholar 

  • Xiang, X., Zhai, M., Lv, N., et al. (2018). Vehicle counting based on vehicle detection and tracking from aerial videos. Sensors, 18(8), 2560.

    Article  Google Scholar 

  • Xu, H., Zhou, W., Zhu, J., et al. (2017). Vehicle counting based on double virtual lines. Signal, Image and Video Processing, 11(5), 905–912.

    Article  Google Scholar 

  • Yang, H., & Qu, S. (2017). Real-time vehicle detection and counting in complex traffic scenes using background subtraction model with low-rank decomposition. IET Intelligent Transport Systems, 12(1), 75–85.

    Article  Google Scholar 

  • Yoon, J., Noble, B., & Liu, M. (2007). Surface street traffic estimation. In Proceedings of the 5th International Conference on Mobile Systems, Applications and Services. Association for Computing Machinery, New York, NY, USA, MobiSys ’07, (pp. 220-232), https://doi.org/10.1145/1247660.1247686.

  • Zhang, Y., Zhao, C., & Zhang, Q. (2016). Counting vehicles in urban traffic scenes using foreground time-spatial images. IET Intelligent Transport Systems, 11(2), 61–67.

    Article  Google Scholar 

  • Zuo, X., Yu, J., Xian, T., et al. (2021). Road obstacle object detection based on improved yolo v4. International Journal of Advanced Network, Monitoring and Controls, 6(3), 18–25.

    Article  Google Scholar 

Download references

Funding

All authors certify that they have no affiliations with or involvement in any organization or entity with any financial or non-financial interest in the subject matter or materials discussed in this manuscript.

Author information

Author notes

  1. Prabu Mohandas, Srijith C. S. authors contributed equally to this work.

Authors and Affiliations

  1. Intelligent Computing Lab, Department of Computer Science and Engineering, National Institute of Technology Calicut, Calicut, Kerala, India

    Krishnendhu S. P. & Prabu Mohandas

  2. Traffic Signal Division, Kerala State Electronics Development Corporation Limited (KELTRON), Thiruvananthapuram, Kerala, India

    Srijith C. S.

Authors
  1. Krishnendhu S. P.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Prabu Mohandas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Srijith C. S.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krishnendhu S. P..

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

S. P., K., Mohandas, P. & C. S., S. Smart junction: advanced zone-based traffic control system with integrated anomaly detector. Ann Oper Res (2023). https://doi.org/10.1007/s10479-023-05452-w

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10479-023-05452-w

Keywords

Search

Navigation