Skip to main content

An automatic verification method for vehicle line-pressing violation based on CNN and geometric projection

Abstract

Vision-based detection of vehicle line-pressing violation has been widely used in intelligent transportation system. However, the accuracy of most current methods is low due to weather, illumination, shooting angle, etc., which increases the workload of manual verification. To cope with these problems, an efficient automatic verification method of vehicle line-pressing violation is proposed based on convolutional neural network (CNN) and geometric projection. First, a CNN model is used to detect vehicles and features are extracted to match the vehicles with line-pressing violation. Second, based on driving direction and vehicle 2D bounding box, pose relationship of the vehicles to the ground is fitted. Finally, according to the relationship between lane line and vehicle chassis range, automatic verification of vehicle line-pressing violation is realized. In the experimental results, the recall rate and accuracy rate reached 90.3 and 99.7% respectively in 200 test samples, which is better than those of current methods. The experimental results show that the proposed method has high accuracy, recall rate and good performance, and can be used for the automatic verification of vehicle line-pressing violation.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. Bashir RMS, Shahzad M, Fraz MM (2019) VR-PROUD: vehicle re-identification using PROgressive unsupervised deep architecture. Pattern Recognit 90:52–65. https://doi.org/10.1016/j.patcog.2019.01.008

    Article  Google Scholar 

  2. Chaudhari P, Yawle R, Chaudhari P (2017) Traffic violation detection and penalty generation system at a street intersection. In: Proceedings of the International Conference on Data Engineering and Communication Technology. Advances in Intelligent Systems and Computing, vol 468, pp 799–807. Springer, Singapore. https://doi.org/10.1007/978-981-10-1675-2_79

  3. Dua M, Singla R, Raj S, Jangra A (2021) Deep CNN models-based ensemble approach to driver drowsiness detection. Neural Comput Appl 33(8):3155–3168

    Article  Google Scholar 

  4. Fan H, Zheng L, Yan C, Yang Y (2018) Unsupervised person re-identification: clustering and fine-tuning. ACM Trans Multimed Comput Commun Appl. https://doi.org/10.1145/3243316

    Article  Google Scholar 

  5. Guo H, Zhao C, Liu Z et al (2018) Learning coarse-to-fine structured feature embedding for vehicle re-identification. In: 2018 Thirty-Second AAAI Conference on Artificial Intelligence, pp 6853–6860, New Orleans, LA

  6. Han C, Ye J, Zhong Y et al (2019) Re-ID driven localization refinement for person search. In: Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV), pp 9813–9822, Seoul, South Korea. https://doi.org/10.1109/ICCV.2019.00991

  7. He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-CNN. In: Proceedings of 16th IEEE International Conference on Computer Vision (ICCV), pp 2980–2988, Venice, Italy. https://doi.org/10.1109/ICCV.2017.322

  8. Li B, Ouyang W, Sheng L et al (2019) GS3D: An efficient 3D object detection framework for autonomous driving. In: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 1019–1028, Long Beach, CA, USA. https://doi.org/10.1109/CVPR.2019.00111

  9. Lin T, Dollár P, Girshick R et al (2017) Feature pyramid networks for object detection. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 936–944, Honolulu, HI, USA. https://doi.org/10.1109/CVPR.2017.106

  10. Liu H, Tian Y, Wang Y et al (2016) Deep relative distance learning: tell the difference between similar vehicles. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2167–2175, Seattle, WA, USA. https://doi.org/10.1109/CVPR.2016.238

  11. Liu C, Cao Y, Luo Y (2019) Vehicle real-time detection system based on video image. Comput Eng 02:265–269

    Google Scholar 

  12. Lou Y, Bai Y, Liu J et al (2019) Embedding adversarial learning for vehicle re-identification. IEEE Trans Image Process 28:3794–3807. https://doi.org/10.1109/TIP.2019.2902112

    MathSciNet  Article  MATH  Google Scholar 

  13. Luo H, Jiang W, Gu Y et al (2019) A strong baseline and batch normalization neck for deep person re-identification. IEEE Trans Multimed. https://doi.org/10.1109/TMM.2019.2958756

    Article  Google Scholar 

  14. Meng D, Li L, Liu X et al (2020) Parsing-based view-aware embedding network for vehicle re-identification. In: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 7101–7110. https://doi.org/10.1109/CVPR42600.2020.00713

  15. Mousavian A, Anguelov D, Flynn J, Košecká J (2017) 3D bounding box estimation using deep learning and geometry. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 5632–5640, Honolulu, HI, USA. https://doi.org/10.1109/CVPR.2017.597

  16. Qiu K, Wang Z (2019) Lane-crossing detection method of vehicles with in-vehicle image. Comput Syst Appl 28(11):188–194

    Google Scholar 

  17. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39:1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  18. Roddick T, Kendall A, Cipolla R (2018) Orthographic feature transform for monocular 3d object detection. arXiv preprint https://arxiv.org/abs/1811.08188

  19. Tekin B, Sinha SN, Fua P (2018) Real-time seamless single shot 6D object pose prediction. In: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 292–301, Salt Lake City, UT, USA. https://doi.org/10.1109/CVPR.2018.00038

  20. Voigtlaender P, Krause M, Osep A et al (2019) MOTS: multi-object tracking and segmentation. In: Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 7934–7943, Long Beach, CA, USA. https://doi.org/10.1109/CVPR.2019.00813

  21. Wang Z, Zheng L, Liu Y, Wang S (2020) Towards real-time multi-object tracking. In: Proceedings of 16th European Conference on Computer Vision, Glasgow, UK, USA. https://doi.org/10.1007/978-3-030-58621-8_7

  22. Xiao T, Li S, Wang B et al (2017) Joint detection and identification feature learning for person search. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3376–3385, Honolulu, HI, USA. https://doi.org/10.1109/CVPR.2017.360

  23. Yin X, Zhang J, Wu X et al (2019) An improved lane departure warning algorithm based on fusion of F-Kalman filter and F-TLC. Multimed Tools Appl 78:12203–12222. https://doi.org/10.1007/s11042-018-6762-2

    Article  Google Scholar 

  24. Yu Y (2002) Research and design of safety road rolling detecting system. Comput Eng 28(9):219–220

    Google Scholar 

  25. Zhao W, Zhan Y, Yan Y (2010) Design and implementation of pressure line detection algorithm based on wavelet transform. Comput Eng Des 31(10):2412–2415

    Google Scholar 

  26. Zheng F, Luo S, Song K et al (2018) Improved lane line detection algorithm based on hough transform. Pattern Recognit Image Anal 28:254–260. https://doi.org/10.1134/S1054661818020049

    Article  Google Scholar 

  27. Zhou X, Wang D, Krähenbühl P (2019) Objects as points. arXiv preprint https://arxiv.org/abs/1904.07850

Download references

Funding

This work is being supported by the National Key Research and Development Project of China under Grant No. 2020AAA0104001, the Zhejiang Provincial Science and Technology Planning Key Project of China under Grant No. 2021C03129 and the Zhejiang Lab. under Grant No. 2019KD0AD011005.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Fei Gao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gao, F., Zhou, M., Weng, L. et al. An automatic verification method for vehicle line-pressing violation based on CNN and geometric projection. J Ambient Intell Human Comput (2021). https://doi.org/10.1007/s12652-021-03400-9

Download citation

Keywords

  • Vehicle re-identification
  • Vehicle line-pressing detection
  • Feature fusion
  • Traffic violation