Skip to main content
SpringerLink
Log in

Embedded and real time vehicle classification system with occlusion handling

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The idea of applying AI in embedded systems is growing in all sectors, from airplanes to drones, cars, cell phones and robots. The challenge for this type of embedded systems is to ensure real-time functioning, with accurate results under a robust system. In this paper, we propose an embedded and real-time road traffic classification system based on AI techniques. The software part includes the different blocks dedicated to vehicle counting and classification, which is performed by using background subtraction, Histograms of Oriented Gradients and Support Vector Machine. The proposed method also includes a set of linear and non-linear filtering techniques for noise removal. The occlusion handling is applied during classification process by training the model on classes containing occlusion images. The hardware part of the system consists of Raspberry Pi board with an operating system installed for flexibility purposes. The implemented algorithm has been improved to guarantee a real time operation and a minimal storage in the memory. The proposed system achieved a counting accuracy of 96.34%, and a processing speed around 4.55 FPS, which is adequate with all the performance and real time criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Aggarwal S (2014) Flask framework cookbook. Packt Publishing Ltd.

    Google Scholar 

  2. Alphonse AS, Starvin MS (2019) A novel maximum and minimum response-based Gabor (MMRG) feature extraction method for facial expression recognition. Multimed Tools Appl 78:23369–23397. https://doi.org/10.1007/s11042-019-7646-9

    Article  Google Scholar 

  3. Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2, 3, article 27, 27 pages. https://doi.org/10.1145/1961189.1961199

  4. Chang J, Wang L, Meng G, Xiang S, Pan C (Summer 2018) Vision-based occlusion handling and vehicle classification for traffic surveillance systems. IEEE Intell Transp Syst Mag 10(2):80–92. https://doi.org/10.1109/MITS.2018.2806619

    Article  Google Scholar 

  5. Comer ML, Delp EJ III (1999) Morphological operations for color image processing. J Electron Imaging 8(3):279. https://doi.org/10.1117/1.482677

    Article  Google Scholar 

  6. Dai Z, Song H, Wang X, Fang Y, Yun X, Zhang Z, Li H (2019) Video-based vehicle counting framework. IEEE Access 7::64460–64470

  7. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), pp 886-893 vol 1. https://doi.org/10.1109/CVPR.2005.177

  8. Derrouz H, Elbouziady A, Abdelali HA, Thami ROH, El Fkihi S, Bourzeix F (2019) Moroccan video intelligent transport system: vehicle type classification based on three-dimensional and two-dimensional features. IEEE Access 7:72528–72537

    Article  Google Scholar 

  9. Ding L, Goshtasby A (2001) On the canny edge detector. Pattern Recogn 34(3):721–725. https://doi.org/10.1016/S0031-3203(00)00023-6

    Article  MATH  Google Scholar 

  10. Dziri A, Duranton M, Chapuis R (2016) Real-time multiple objects tracking on Raspberry-Pi-based smart embedded camera. J Electron Imaging 25(4):041005

    Article  Google Scholar 

  11. Espejel-García D, Ortíz-Anchondo LR, Alvarez-Herrera C, Hernandez-López A, Espejel-García VV, Villalobos-Aragón A (2017) An alternative vehicle counting tool using the Kalman filter within MATLAB. Civil Eng J 3(11):1029–1035

    Article  Google Scholar 

  12. Garcia-Garcia B, Bouwmans T, Silva AJR (2020) Background subtraction in real applications: challenges, current models and future directions. Comput Sci Rev 35:100204

    Article  MathSciNet  Google Scholar 

  13. Ghosh A, Sabuj MS, Sonet HH, Shatabda S, Farid DM (2019) An adaptive video-based vehicle detection, classification, counting, and speed-measurement system for real-time traffic data collection. In: 2019 IEEE region 10 symposium (TENSYMP) (pp 541-546). IEEE

  14. Greenhalgh P (2011) Big. LITTLE processing with ARM Cortex-A15 & Cortex-A7: Improving energy efficiency in high-performance mobile platforms. White paper, ARM Ltd.

  15. Guerrero-Gomez-Olmedo R, Lopez-Sastre RJ, Maldonado-Bascon S, Fernandez-Caballero A (2013) Vehicle tracking by simultaneous detection and viewpoint estimation. In: IWINAC 2013, Part II, LNCS 7931, pp 306–316

  16. Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122

    Article  Google Scholar 

  17. Huang DY, Chen CH, Chen TY, Hu WC, Lin YL (2016) A vehicle flow counting system in rainy environment based on vehicle feature analysis. J Inf Hiding Multimed Signal Process 7(1):101–114

    Google Scholar 

  18. Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground–background segmentation using codebook model. Real-Time Imaging 11(3):172–185

    Article  Google Scholar 

  19. Kim K, Harwood D, Davis LS (2005) Background updating for visual surveillance. In: International symposium on visual computing. Springer, Berlin, Heidelberg, pp 337–346

    Google Scholar 

  20. Maddalena L, Petrosino A (2018) Background subtraction for moving object detection in RGBD data: a survey. J Imaging 4(5):71

    Article  Google Scholar 

  21. Moutakki Z, Ouloul IM, Afdel K, Amghar A (2017) Real-time video surveillance system for traffic management with background subtraction using codebook model and occlusion handling. Transp Telecommun 18(4):297–306

    Google Scholar 

  22. Moutakki Z, Ouloul IM, Afdel K, Amghar A (2018) Real-time system based on feature extraction for vehicle detection and classification. Transp Telecommun 19(2):93–102

    Google Scholar 

  23. Piccardi M (2004) Background subtraction techniques: a ereview. In: 2004 IEEE international conference on systems, man and cybernetics (IEEE Cat. No. 04CH37583) (vol 4, pp 3099-3104). IEEE

  24. Raspberry Pi Ltd. (2019) Raspberry Pi 4 Model B. https://datasheets.raspberrypi.com/rpi4/raspberry-pi-4-datasheet.pdf. Accessed 5 Jul 2021

  25. Raspberry Pi Ltd. (n.d.) BCM2711 ARM Peripherals. https://datasheets.raspberrypi.com/bcm2711/bcm2711-peripherals.pdf. Accessed 7 Apr 2021

  26. Shanableh T (2021) Feature extraction and machine learning solutions for detecting motion vector data embedding in HEVC videos. Multimed Tools Appl 80:27047–27066. https://doi.org/10.1007/s11042-020-09826-1

    Article  Google Scholar 

  27. Soleh M, Jati G, Hilman MH (2018) Multi object detection and tracking using optical flow density–Hungarian Kalman filter (Ofd-Hkf) algorithm for vehicle counting. Jurnal Ilmu Komputer dan Informasi 11(1):17–26

    Article  Google Scholar 

  28. Srijongkon K, Duangsoithong R, Jindapetch N, Ikura M, Chumpol S (2017) SDSoC based development of vehicle counting system using adaptive background method. In: 2017 IEEE Regional Symposium on Micro and Nanoelectronics (RSM), pp 235–238. https://doi.org/10.1109/RSM.2017.8069172

    Chapter  Google Scholar 

  29. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149) (vol 2, pp 246-252). IEEE

  30. Sun W, Zhang G, Zhang X, Zhang X, Ge N (2021) Fine-grained vehicle type classification using lightweight convolutional neural network with feature optimization and joint learning strategy. Multimed Tools Appl 80:30803–30816. https://doi.org/10.1007/s11042-020-09171-3

    Article  Google Scholar 

  31. Tapp C (2008) An introduction to MISRA C++. SAE International Journal of Passenger Cars-Electronic and Electrical Systems 1(2008-01-0664):265–268

  32. Velazquez-Pupo R, Sierra-Romero A, Torres-Roman D, Shkvarko YV, Santiago-Paz J, Gómez-Gutiérrez D, Robles-Valdez D, Hermosillo-Reynoso F, Romero-Delgado M (2018) Vehicle detection with occlusion handling, tracking, and OC-SVM classification: a high performance vision-based system. Sensors 18:374. https://doi.org/10.3390/s18020374

    Article  Google Scholar 

  33. Wen X, Shao L, Xue Y, Fang W (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295:395–406

    Article  Google Scholar 

  34. Xu Y, Li Z, Wang S, Li W, Sarkodie-Gyan T, Feng S (2021) A hybrid deep-learning model for fault diagnosis of rolling bearings. Measurement 169:108502

    Article  Google Scholar 

  35. Yang H, Qu S (2017) Real-time vehicle detection and counting in complex traffic scenes using background subtraction model with low-rank decomposition. IET Intell Transp Syst 12(1):75–85

    Article  MathSciNet  Google Scholar 

  36. Zhao N, Xia Y, Xu C, Shi X, Liu Y (2016) APPOS: an adaptive partial occlusion segmentation method for multiple vehicles tracking. J Vis Commun Image Represent 37:25–31. https://doi.org/10.1016/j.jvcir.2015.04.011

    Article  Google Scholar 

Download references

Author information

Author notes

  1. Zakaria Moutakki

    Present address: Industrial Technologies and Services Laboratory, Higher School of Technology, Sidi Mohamed Ben Abdellah University, 30000, Fez, Morocco

  2. Imad Mohamed Ouloul & Abdellah Amghar

    Present address: Metrology and Information Processing Lab, Ibnou Zohr University, B.P 80000, Agadir, Morocco

  3. Karim Afdel

    Present address: Computer Systems and Vision Lab, Ibnou Zohr University, B.P 80000, Agadir, Morocco

Authors and Affiliations

  1. ENSA, Sidi Mohamed Ben Abdellah University, 30000, Fez, Morocco

    Saad Motahhir

Authors
  1. Zakaria Moutakki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Imad Mohamed Ouloul
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdellah Amghar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Saad Motahhir
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Karim Afdel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saad Motahhir.

Ethics declarations

Conflict of interest

The authors declare no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moutakki, Z., Ouloul, I.M., Amghar, A. et al. Embedded and real time vehicle classification system with occlusion handling. Multimed Tools Appl 82, 24407–24423 (2023). https://doi.org/10.1007/s11042-023-14852-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14852-w

Keywords

Search

Navigation