Skip to main content
SpringerLink
Log in

Single-sensor imaging in consumer digital cameras: a survey of recent advances and future directions

  • Survey Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper surveys in a systematic way recent advances in single-sensor imaging. In particular, the most distinctive elements of a single-sensor imaging pipeline, such as color filter array configurations, image interpolation solutions, and picture storage approaches are reviewed and commented upon. New perspectives in the field are proposed, suggesting that the demand for consumer digital camera solutions and digital color imaging applications will continue.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Lukac R, Plataniotis KN, Hatzinakos D (2005) Color image zooming on the Bayer pattern. IEEE Trans Circuits Syst Video Technol 15(11):1475–1492

    Article  Google Scholar 

  2. Parulski K, Spaulding KE (2002) Color image processing for digital cameras. In: Sharma G (eds) Digit Color Imaging Handb. CRC, Boca Raton, pp 728–757

    Google Scholar 

  3. Lukac R, Plataniotis KN (2005) Color filter arrays: design and performance analysis. IEEE Trans Consum Electron 51(4):1260–1267

    Article  Google Scholar 

  4. Ramanath R, Snyder WE, Yoo Y, Drew MS (2005) Color image processing pipeline. IEEE Signal Process Mag 22(1):34–43

    Article  Google Scholar 

  5. Gunturk BK, Glotzbach J, Altunbasak Y, Schaffer RW, Murserau RM (2005) Demosaicking: color filter array interpolation. IEEE Signal Process Mag 22(1):44–54

    Article  Google Scholar 

  6. Lukac R, Plataniotis KN (2005) Data-adaptive filters for demosaicking: a framework. IEEE Trans Consum Electron 51(2):560–570

    Article  Google Scholar 

  7. Zhang L, Wu X (2005) Color demosaicking via directional linear minimum mean square-error estimation. IEEE Trans Image Process 14(12):2167–2178

    Article  Google Scholar 

  8. Lukac R, Smolka B, Martin K, Plataniotis KN, Venetsanopulos AN (2005) Vector filtering for color imaging. IEEE Signal Process Mag 22(1):74–86

    Article  Google Scholar 

  9. Vrhel M, Saber E, Trussell HJ (2005) Color image generation and display technologies. IEEE Signal Process Mag 22(1):23–33

    Article  Google Scholar 

  10. Sharma G, Trussell HJ (1997) Digital color imaging. IEEE Trans Image Process 6(7):901–932

    Article  Google Scholar 

  11. Lyon RF, Hubel PM (2002) Eyeing the camera: Into the next century. In: Proc. IS&TSID Tenth Color Imaging Conference, Scottsdale, USA, pp 349–355

  12. Battiato S, Castorina A, Guarnera M, Vivirito P (2003) A global enhancement pipeline for low-cost imaging devices. IEEE Trans Consum Electron 49(3):670–675

    Article  Google Scholar 

  13. Lukac R, Plataniotis KN (2006) Single-sensor camera image compression. IEEE Trans Consum Electron 52(2):299–307

    Article  Google Scholar 

  14. Technical Committee ISO/TC 42, photography, electronic still picture imaging-removable memory, Part 2: Image data format-TIFF/EP. ISO 12234–2, January 2001

  15. Information technology–digital compression and coding of continuous-tone still images: requirements and guidelines, ISO/IEC Intern. Standard 10918–1, ITU-T Recommendation T.81, 1994

  16. Koh CC, Mukherjee J, Mitra SK (2003) New efficient methods of image compression in digital cameras with color filter array. IEEE Trans Consum Electron 49(4):1448–1456

    Article  Google Scholar 

  17. Bazhyna A, Gotchev A, Egiazarian K (2008) Near-lossless compression algorithm for Bayer pattern color filter arrays. SPIE-IS&T Electronic Imaging: Digital Photography 5678:198–209

    Google Scholar 

  18. Zhang L, Wu X, Bao P (2005) Real-time lossless compression of mosaic video sequences. Real-Time Imaging 11(5–6):370–377

    Article  Google Scholar 

  19. Colet P (2005) Real-time, high-speed image processing: how to choose the right hardware and organize it properly. Toshiba Advanced Imaging Mag

  20. Yoon K, Kim C, Lee B, Lee D (2002) Single-chip CMOS image sensor for mobile applications. IEEE J of Solid-State Circuit 37(12):1839–1845

    Article  Google Scholar 

  21. Technical Standardization Committee on AV & IT storage systems and equipment, exchangeable image file format for digital still cameras: Exif Version 2.2. JEITA CP-3451, April 2002

  22. Information Technology–JPEG 2000 image coding system, ISO/IEC Intern. Standard 15444–1, ITU Recommendation T.800, 2000

  23. Battiato S, Bruna AR, Buemi A, Castorina A (2003) Analysis and characterization of JPEG 2000 standard for imaging devices. IEEE Trans Consum Electron 49(4):773–779

    Article  Google Scholar 

  24. Lukac R, Martin K, Plataniotis KN (2004) Digital camera zooming based on unified CFA image processing steps. IEEE Trans Consum Electron 50(1):15–24

    Article  Google Scholar 

  25. Lukac R, Plataniotis KN : A vector spectral model for digital camera image processing. IEEE Trans Circuit Syst Video Technol, revised submitted

  26. Sakamoto T, Nakanishi C, Hase T (1998) Software pixel interpolation for digital still cameras suitable for a 32-bit MCU. IEEE Trans Consum Electron 44(4):1342–1352

    Article  Google Scholar 

  27. Gunturk B, Altunbasak Y, Mersereau R (2002) Color plane interpolation using alternating projections. IEEE Trans Image Process 11(9):997–1013

    Article  Google Scholar 

  28. Alleysson D, Susstrunk S, Herault J (2005) Linear demosaicing inspired by the human visual system. IEEE Trans Image Process 14(4):439–449

    Article  Google Scholar 

  29. Muresan DD, Parks TW (2005) Demosaicing using optimal recovery. IEEE Trans Image Process 14(2):267–278

    Article  Google Scholar 

  30. Li X (2005) Demosaicing by successive approximation. IEEE Trans Image Process 14(3):370–379

    Article  Google Scholar 

  31. Hamilton JF, Adams JE (1997) Adaptive color plane interpolation in single sensor color electronic camera. U.S. Patent 5 652 621

  32. Chang L, Tang YP (2004) Effective use of spatial and spectral correlations for color filter array demosaicking. IEEE Trans Consum Electron 50(2):355–365

    Article  Google Scholar 

  33. Lukac R, Plataniotis KN, Hatzinakos D, Aleksic M (2004) A novel cost effective demosaicing approach. IEEE Trans Consum Electron 50(1):256–261

    Article  Google Scholar 

  34. Lu W, Tang YP (2003) Color filter array demosaicking: new method and performance measures. IEEE Trans Image Process 12(10):1194–1210

    Article  Google Scholar 

  35. Hirakawa T, Parks TW (2005) Adaptive homogeneity-directed demosaicing algorithm. IEEE Trans Image Process 14(3):360–369

    Article  Google Scholar 

  36. Lukac R, Martin K, Plataniotis KN (2004) Demosaicked image post-processing using local color ratios. IEEE Trans Circuit Syst Video Technol 14(6):914–920

    Article  Google Scholar 

  37. Lukac R, Plataniotis KN (2005) A robust, cost-effective postprocessor for enhancing demosaicked camera images. Real-Time Imaging 11(2):139–150

    Article  Google Scholar 

  38. Battiato S, Gallo G, Stanco F (2002) A locally adaptive zooming algorithm for digital images. Image Vision Comput 20(11):805–812

    Article  Google Scholar 

  39. Lukac R, Plataniotis KN (2005) Digital zooming for color filter array based image sensors. Real-Time Imaging 11(2):129–138

    Article  Google Scholar 

  40. Kang MG, Chaudhuri (eds.), Super resolution image reconstruction, special issue of IEEE Signal Processing Mag 20(3):19–86

  41. Narasimhan SG, Nayar SK (2005) Enhancing resolution along multiple imaging dimensions using assorted pixels. IEEE Trans Pattern Anal Mach Intell 27(4):518–530

    Article  Google Scholar 

  42. Farsiu S, Elad M, Milanfar P (2006) Multiframe demosaicing and super-resolution of color images. IEEE Trans Image Process 15(1):141–159

    Article  Google Scholar 

  43. Lukac R, Plataniotis KN (2005) Fast video demosaicking solution for mobile phone imaging applications. IEEE Trans Consum Electron 51(2):675–681

    Article  Google Scholar 

  44. Wu X, Zhang L (2006) Temporal color video demosaicking via motion estimation and data fusion. IEEE Trans Circuit Syst Video Technol 16(2):231–240

    Article  Google Scholar 

  45. Lukac R, Plataniotis KN (2005) Universal demosaicking for imaging pipelines with an RGB color filter array. Pattern Recognit 38(11):2208–2212

    Article  Google Scholar 

  46. Blythe P, Fridrich J (2004) Secure digital camera. In: Proc. Digital Forensic Research Workshop, in Baltimore, p 12

  47. Lukac R, Plataniotis KN (2005) Digital image indexing using secret sharing schemes: a unified framework for single-sensor consumer electronics. IEEE Trans Consum Electron 51(3):908–916

    Article  Google Scholar 

  48. Lukac R, Plataniotis KN (2006) Secure single-sensor digital camera. Electron Lett 42(11):627–629

    Article  Google Scholar 

  49. Mehdi KL, Sencar HT, Memon N (2004) Blind source camera identification. In: Proceedings of the International Conference on Image Processing in Singapore 1:709–712

  50. Popescu AC, Farid H (2005) Exposing digital forgeries in color filter array interpolated images. IEEE Trans Signal Process 53(10):3948–3959

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Multimedia Laboratory, BA 4157, The Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, 10 King’s College Road, Toronto, ON, Canada, M5S 3G4

    Rastislav Lukac

Authors
  1. Rastislav Lukac
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rastislav Lukac.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lukac, R. Single-sensor imaging in consumer digital cameras: a survey of recent advances and future directions. J Real-Time Image Proc 1, 45–52 (2006). https://doi.org/10.1007/s11554-006-0003-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-006-0003-z

Keywords

Search

Navigation