Skip to main content

Design and Verification Environment for High-Performance Video-Based Embedded Systems

  • Chapter
  • First Online:

Abstract

In this chapter, we propose a design and verification environment for computational demanding and secure embedded vision-based systems. Starting with an executable specification in OpenCV, we provide subsequent refinements and verification down to a system-on-chip prototype into an FPGA-based smart camera. At each level of abstraction, properties of image processing applications are used along with structure composition to provide a generic architecture that can be automatically verified and mapped to a lower abstraction level, the last of which being the FPGA. The result of this design flow is a framework that encapsulates the computer vision library OpenCV at the highest level, integrates Accelera’s SystemC/TLM with the Universal Verification Methodology (UVM) and QEMU-OS for virtual prototyping, verification, and low-level mapping.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Assertion-Based Verification. Springer, US. doi:

    Google Scholar 

  2. Axi interconnect. http://www.xilinx.com/products/intellectual-property/axi_interconnect.htm

  3. Generic and automatic specman based verification environment for image signal processing ips. http://design-reuse.com/articles/20907/specman-verification-image-signal-processing-ip

  4. Tlmu. http://edgarigl.github.io/tlmu

  5. Aghajan H, Cavallaro A (2009) Multi-camera networks: principles and applications. Academic Press, Waltham

    Google Scholar 

  6. Alfaro L, Henzinger T, Interface-based design 195:83–104. doi:10.1007/1-4020-3532-23

  7. Appiah K, Hunter A, Kluge T, Aiken P, Dickinson P (2009) FPGA-based anomalous trajectory detection using SOFM. In: Proceedings of the 5th international workshop on reconfigurable computing: architectures, tools and applications, ARC’09, pp 243–254. Springer, Berlin. doi:10.1007/978-3-642-00641-8_24

  8. Bramberger M, Doblander A, Maier A, Rinner B, Schwabach H (2006) Distributed embedded smart cameras for surveillance applications. IEEE Comput Soc 39:68–75

    Article  Google Scholar 

  9. Chen P, Ahammad P, Boyer C, Huang SI, Lin L, Lobaton E, Meingast M, Oh S, Wang S, Yan P, Yang AY, Yeo C, Chang LC, Tygar D, Sastry SS (2008) Citric: a low-bandwidth wireless camera network platform. In: Second ACM/IEEE international conference on distributed smart cameras, pp 1–10

    Google Scholar 

  10. Guenard N, Hamel T, Mahony R (2008) A practical visual servo control for an unmanned aerial vehicle. IEEE Trans Rob 24(2):331–340. doi:10.1109/TRO.2008.916666

    Article  Google Scholar 

  11. Kim J, Sukkarieh S (2004) Slam aided GPS/INS navigation in GPS denied and unknown environments. In: The 2004 international symposium on GNSS/GPS, Sydney, pp 6–8

    Google Scholar 

  12. Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground-background segmentation using codebook model. Real-Time Imaging 11(3):172–185. doi:10.1016/j.rti.2004.12.004

    Article  Google Scholar 

  13. Lin F, Lum KY, Chen B, Lee T, Development of a vision-based ground target detection and tracking system for a small unmanned helicopter. Sci China Ser F. Inf Sci 52(11):2201–2215. doi:10.1007/s11432-009-0187-5

  14. Mefenza M, Yonga F, Bobda C (2013) Razorcam: an embedded platform for image processing. In: ASEE midwest conference

    Google Scholar 

  15. Mefenza M, Yonga F, Bobda C (2013) ACM hotmobile 2013 poster: Razorcam: a prototyping environment for video communication. SIGMOBILE Mob Comput Commun Rev 17(3):13–14. doi:10.1145/2542095.2542103

  16. Meingast M, Geyer C, Sastry S (2004) Vision based terrain recovery for landing unmanned aerial vehicles. In: 43rd IEEE conference on decision and control (CDC), 2004, vol. 2, pp 1670–1675. doi:10.1109/CDC.2004.1430284.

  17. Nieto M, Cuevas C, Salgado L, Garcia N (2011) Line segment detection using weighted mean shift procedures on a 2d slice sampling strategy. Pattern Anal Appl 14(2):149–163. doi:10.1007/s10044-011-0211-4

    Article  MathSciNet  Google Scholar 

  18. Park J, Lee B, Lim K, Kim J, Kim S, Kwang-Hyun-Baek (2008) Co-simulation of SystemC TLM with RTL HDL for surveillance camera system verification. In: 15th IEEE international conference on electronics, circuits and systems, 2008 (ICECS 2008), pp 474–477. doi:10.1109/ICECS.2008.4674893

  19. Rinner B, Winkler T, Schriebl W, Quaritsch M, Wolf W (2008) The evolution from single to pervasive smart cameras. In: Second ACM/IEEE international conference on distributed smart cameras, 2008 (ICDSC 2008), pp 1–10. doi:10.1109/ICDSC.2008.4635674

  20. Rose A, Swan S, Pierce J, Fernandez J (2005) Transaction level modeling in SystemC. Open SystemC Initiative 1(1.297)

    Google Scholar 

  21. Saha S (2007) Design methodology for embedded computer vision systems. PhD thesis

    Google Scholar 

  22. Samsom H, Franssen F, Catthoor F, De Man H (1995) System level verification of video and image processing specifications. In: Proceedings of the 8th international symposium on system synthesis, 1995, pp 144–149. doi:10.1109/ISSS.1995.520626

  23. Schlessman J, Chen CY, Wolf W, Ozer B, Fujino K, Itoh K (2006) Hardware/software co-design of an fpga-based embedded tracking system. In: Conference on computer vision and pattern recognition workshop, 2006 (CVPRW’06), pp 123–123. doi:10.1109/CVPRW.2006.92

  24. Trost A, Zemva A (2012) Verification structures for design of video processing circuits. In: MIPRO, 2012 proceedings of the 35th international convention, pp 222–227

    Google Scholar 

  25. Wu S, Implementing an automated checking scheme for a video-processing device. www.cadence.com/rl/Resources/conference_papers/1.13Paper

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Mefenza .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Mefenza, M., Yonga, F., Bobda, C. (2014). Design and Verification Environment for High-Performance Video-Based Embedded Systems. In: Bobda, C., Velipasalar, S. (eds) Distributed Embedded Smart Cameras. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7705-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7705-1_4

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-7704-4

  • Online ISBN: 978-1-4614-7705-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics