Skip to main content
SpringerLink
Log in

Smart Camera for Traffic Applications

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

This paper presents a compact intelligent camera with traffic surveillance and enforcement as a primary application field. The camera’s unique features are 1/ embedded object detection of user-defined objects and 2/ excellent image quality achieved by a custom HDR image acquisition and tone mapping. Intelligent cameras are essential parts of equipment in production, control, security and primarily traffic surveillance and enforcement. In many applications, they serve as a versatile source of images processed elsewhere, and reduction of required processing and communication achieved by embedded (pre)processing within the intelligent camera is always welcome. The key blocks of the camera are implemented in FPGA to reduce the CPU load and thus the power requirements. The control software uses an embedded CPU running Linux. The camera is designed to provide key images that are interesting from the application point of view and to provide metadata. On the camera prototype, we observed total power consumption of 8 W and object detection accuracy > 99%. Application designers can extensively modify the camera design and functionality to harness various applications, such as traffic surveillance and enforcement, quality control, etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11

Similar content being viewed by others

Notes

  1. www.xilinx.com

  2. https://zeromq.org/

  3. https://github.com/RomanJuranek/waldboost

References

  1. Yuan, Y., Zou, W., Zhao, Y., Wang, X., Hu, X., & Komodakis, N. (2017). A robust and efficient approach to license plate detection. IEEE Transactions on Image Processing, 26, 1102–1114.

    Article  MathSciNet  MATH  Google Scholar 

  2. Zhai, X., Bensaali, F., & Ramalingam, S. (2011). Real-time license plate localisation on fpga. In: CVPR 2011 WORKSHOPS, pp. 14–19. https://doi.org/10.1109/CVPRW.2011.5981739

  3. Chhabra, S., Jain, H., & Saini, S. (2016). Fpga based hardware implementation of automatic vehicle license plate detection system. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 1181–1187. https://doi.org/10.1109/ICACCI.2016.7732205

  4. Sborz, G. A. M., Pohl, G. A., Viel, F., & Zeferino, C. A. (2019). A custom processor for an fpga-based platform for automatic license plate recognition. In: 2019 32nd Symposium on Integrated Circuits and Systems Design (SBCCI), pp. 1–6.

  5. Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In: CVPR

  6. Dollár, P., Appel, R., Belongie, S., & Perona, P. (2014). Fast feature pyramids for object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(8), 1532–1545.

    Article  Google Scholar 

  7. Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.

    Article  Google Scholar 

  8. Sochman, J., & Matas, J. (2005). Waldboost-learning for time constrained sequential detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol. 2, pp. 150–156. IEEE.

  9. van den Berg, F., Čamra, V., Hendriks, M., Geilen, M., Hnetynka, P., Manteca, F., Sánchez, P., Bureš, T., & Bas-ten, T. (2020). Qrml: A component language and toolset for quality and resource management. In: 2020 Forum for Specification and Design Languages (FDL), pp. 1–8. IEEE.

  10. Musil, M., Nosko, S., & Zemcik, P. (2020). De-ghosted hdr video acquisition for embedded systems. Journal of Real-Time Image Processing, 1–10.

  11. Nosko, S., Musil, M., Zemcik, P., & Juranek, R. (2018). Color hdr video processing architecture for smart camera. Journal of Real-Time Image Processing, 1–12.

  12. Musil, P., Juranek, R., Musil, M., & Zemcik, P. (2020). Cascaded stripe memory engines for multi-scale object detection in FPGA. IEEE Transactions on Circuits and Systems for Video Technology, 30(1), 267–280. https://doi.org/10.1109/tcsvt.2018.2886476

    Article  Google Scholar 

  13. Zemcik, P., Juranek, R., Musil, P., Musil, M., & Hradis, M. (2013). High performance architecture for object detection in streamed videos. In: 2013 23rd International Conference on Field programmable Logic and Applications. IEEE. https://doi.org/10.1109/fpl.2013.6645559

  14. Mitsunari, K., Yu, J., Onoye, T., & Hashimoto, M. (2018). Hardware architecture for high-speed object detection using decision tree ensemble. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences E101.A, 1298–1307. https://doi.org/10.1587/transfun.E101.A.1298

  15. Welch, G., Bishop, G., et al. (1995). An introduction to the kalman filter

  16. National Instruments: NI Smart Cameras. (2018). Retrieved March 2021, from https://www.ni.com/pdf/product-flyers/smart-cameras.pdf

  17. Cognex: 2D MACHINE VISION SYSTEMS. (2022). Retrieved March 2021, from https://www.cognex.com/products/machine-vision/2d-machine-vision-systems

  18. ADLINK: NEON-2000 Series. (2020). Retrieved March 2021, from https://www.adlinktech.com/Products/Deep_Lea6rning_Accelerator_Platform_and_Server/AI_Machine_Vision_Devices/NEO_N-2000-JT2_Series

  19. Al-Ars, Z., et al. (2019). The fitoptivis ecsel project: Highly efficient distributed embedded image/video processing in cyber-physical systems. In: Proceedings of the 16th ACM International Conference on Computing Frontiers, CF ’19, p. 333–338. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3310273.3323437

Download references

Acknowledgements

This work is part of the FitOptiVis project [19] funded by the ECSEL Joint Undertaking under grant number H2020-ECSEL-2017-2-783162. The authors would like to thank to CAMEA company for providing training and testing data.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Brno University of Technology, Brno, Czechia

    Petr Musil, Martin Musil, Svetozár Nosko, Roman Juránek & Pavel Zemčík

Authors
  1. Petr Musil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Martin Musil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Svetozár Nosko
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Roman Juránek
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pavel Zemčík
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pavel Zemčík.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Musil, P., Musil, M., Nosko, S. et al. Smart Camera for Traffic Applications. J Sign Process Syst 95, 1067–1077 (2023). https://doi.org/10.1007/s11265-023-01843-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-023-01843-1

Keywords

Search

Navigation