Abstract
Among thriving cyber physical systems (CPS), smart camera applications require to run both image sensors and image signal processors (ISPs) to capture images whenever necessary. Due to the nature of such applications (i.e., constantly capturing images and analyzing the images to detect any event of interest), the image sensor and ISP become the two most energy consuming components in smart camera applications. In this chapter, we start with our intuition that the perceptive quality of images is not strongly correlated with the accuracy of object detection algorithms and propose three techniques that require only minor modifications to the baseline ISP but dramatically reduce the ISP energy consumption in object detection mode for smart camera applications. When joining three proposed techniques, we demonstrate that our ISP consumes only 3 % of the baseline ISP energy while degrading face detection accuracy by 3–4 %.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
BYD Microelectronics Co., Ltd., QVGA CMOS Image Sensor BF3901 Datasheet
DDC PowerShrink™ Platform. http://www.suvolta.com/technology/ddc/
Buchsbaum G (1980) A spatial processor model for object colour perception. J Franklin Inst 310(1)
Bayer BE (1976) Color imaging array. USA Patent US3971065 (A), 20 July 1976
Parameter values for the HDTV standards for production and international programme exchange. http://www.itu.int/rec/R-REC-BT.709/en
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: EEE computer society conference on computer vision and pattern recognition
Inside the Canon RAW Format Version 2. http://lclevy.free.fr/cr2
OpenCV Library. http://opencv.org/
Tutorial on OpenCV HaarTraining. https://code.google.com/p/tutorial-haartraining/
Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural aimilarity. IEEE Trans Image Proc 13(4)
LiKamWa R (2014) Extended abstract: efficient image processing for continuous mobile vision. ACM PhD Forum
Kim K, Park I-C (2006) Combined image signal processing for CMOS image sensors. In: IEEE international symposium on circuits and system (ISCAS)
van Dalen E, Pestana S, van Wel A (2006) An integrated, low-power processor for image signal processing. In: IEEE international symposium on multimedia (ISM)
Bong K et al (2014) An 1.61 mW Mixed-signal column processor for BRISK feature extraction in CMOS image sensor. IEEE international symposium on circuits and systems (ISCAS)
Acknowledgments
This work is supported by the Center for Integrated Smart Sensors funded by the Ministry of Science, ICT & Future Planning as the Global Frontier Project and an NSF grant (CCF-0953603).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Liu, Z., Kim, N.S. (2016). An Ultra-Low-Power Image Signal Processor for Smart Camera Applications. In: Kyung, CM. (eds) Theory and Applications of Smart Cameras. KAIST Research Series. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9987-4_3
Download citation
DOI: https://doi.org/10.1007/978-94-017-9987-4_3
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-017-9986-7
Online ISBN: 978-94-017-9987-4
eBook Packages: EngineeringEngineering (R0)