Multimedia Tools and Applications

, Volume 78, Issue 1, pp 697–711 | Cite as

Scene-adaptive coded aperture imaging

  • Xuehui Wang
  • Feng DaiEmail author
  • Yike Ma
  • Ke Gao
  • Yong Dong Zhang


Coded aperture imaging systems have recently shown great success in recovering scene depth and extending the depth-of-field. Tremendous efforts have been focused on designing good coded patterns. The ideal pattern, however, would have to serve two conflicting purposes: 1) it should be broadband to ensure robust deconvolution and 2) it should have sufficient zero-crossings for a high depth discrepancy. This paper presents a simple but effective scene-adaptive coded aperture solution to bridge this gap. We observe that natural scenes often exhibit a dominant edge direction that can be caused by structure, texture, shading, etc. We therefore apply depth-discriminative codes along the dominant direction and broadband codes along its orthogonal direction. To physically implement this scheme, we adopt a two-shot scheme. Firstly, we capture a scene image with a pinhole aperture and analyze image content to determine the dominant direction. Secondly, we apply the proposed coding scheme using the programmable Liquid Crystal on Silicon (LCoS). Experiments on a broad range of synthetic and real scenes show that our technique is able to combine advantages of the state-of-the-art patterns for recovering better quality depth map and all-focus images.


Computational imaging Coded-aperture Depth-from-defocus 


  1. 1.
    Bando Y, Chen BY, Nishita T (2008) Extracting depth and matte using a color-filtered aperture. ACM Trans Graphics 27(5):134CrossRefGoogle Scholar
  2. 2.
    Chakrabarti A, Zickler T (2012) Depth and deblurring from a spectrally-varying depth-of-field. In: ECCVGoogle Scholar
  3. 3.
    Ding Y, McCloskey S, Yu J (2010) Analysis of motion blur with a flutter shutter camera for non-linear motion. In: ECCVGoogle Scholar
  4. 4.
    Dowski ER, Cathey WT et al (1995) Extended depth of field through wave-front coding. Appl Opt 34(11):1859–1866CrossRefGoogle Scholar
  5. 5.
    Grossmann P (1987) Depth from focus. Pattern Recogn Lett 5(1):63–69CrossRefGoogle Scholar
  6. 6.
    Hasinoff SW, Kutulakos KN, Durand F, Freeman WT (2009) Time-constrained photography. In: ICCVGoogle Scholar
  7. 7.
    Hiura S, Matsuyama T (1998) Depth measurement by the multi-focus camera. In: CVPRGoogle Scholar
  8. 8.
    Krishnan D, Fergus R (2009) Fast image deconvolution using hyper-laplacian priors. In: Advances in neural information processing systems, pp 1033–1041Google Scholar
  9. 9.
    Levin A, Fergus R, Durand F, Freeman WT (2007) Image and depth from a conventional camera with a coded aperture. ACM Trans Graphics 26(3):70CrossRefGoogle Scholar
  10. 10.
    Mannami H, Sagawa R, Mukaigawa Y, Echigo T, Yagi Y (2007) High dynamic range camera using reflective liquid crystal. In: ICCVGoogle Scholar
  11. 11.
    Nagahara H, Zhou C, Watanabe T, Ishiguro H, Nayar S (2010) Programmable aperture camera using LCos. In: ECCVGoogle Scholar
  12. 12.
    Raskar R, Agrawal A, Tumblin J (2006) Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans Graphics 25(3):795–804CrossRefGoogle Scholar
  13. 13.
    Takeda Y, Hiura S, Sato K (2013) Fusing depth from defocus and stereo with coded apertures. In: CVPRGoogle Scholar
  14. 14.
    Veeraraghavan A, Raskar R, Agrawal A, Mohan A, Tumblin J (2007) Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans Graphics 26(3):69CrossRefGoogle Scholar
  15. 15.
    Wang Z, Bovik AC, Sheikh HR, PSimoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Processing 13(4):600–612CrossRefGoogle Scholar
  16. 16.
    Yuan L, Sun J, Quan L, Shum HY (2007) Image deblurring with blurred/noisy image pairs. ACM Trans Graphics 26(3):1CrossRefGoogle Scholar
  17. 17.
    Zhou C (2009) What are good apertures for defocus deblurring?. In: ICCPGoogle Scholar
  18. 18.
    Zhou C, Lin S, Nayar S (2009) Coded aperture pairs for depth from defocus. In: ICCVGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2017

Authors and Affiliations

  • Xuehui Wang
    • 1
    • 2
  • Feng Dai
    • 1
    Email author
  • Yike Ma
    • 1
  • Ke Gao
    • 1
  • Yong Dong Zhang
    • 1
  1. 1.Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS)Institute of Computing Technology, CASBeijingChina
  2. 2.Graduate University of Chinese Academy of SciencesBeijingChina

Personalised recommendations