Abstract
Dynamic range compression has become an important function used in modern digital video cameras to improve visual quality of color images suffered from low dynamic range and poor contrast defects. This study addresses real-time implementation of an adaptive dynamic range compression algorithm for color image/video enhancement. To achieve this purpose, we first propose a new image-dependent nonlinear intensity-transfer function to produce a satisfactory dynamic range compression result with less color artifacts. The proposed algorithm is then derived by combining the new adaptive nonlinear intensity-transfer function with an efficient local contrast enhancement algorithm. Moreover, an algorithmic acceleration method is also presented to accelerate the processing speed of the proposed color image enhancement method, achieving real-time performance in processing high-definition video signals. Experimental results validate the performance of the developed method in terms of quantitative evaluation, visual quality, computational efficiency, and power consumption.
Similar content being viewed by others
References
Land, E.: Recent advances in Retinex theory. Vis. Res. 26(1), 7–21 (1986)
Jobson, D., Rahman, Z., Woodell, G.: A multiscale Retinex for bridging the gap between color images and human observation of scenes. IEEE Trans. Image Process. 6(7), 965–976 (1997)
Bertalmío, M., Caselles, V., Provenzi, E., Rizzi, A.: Perceptual color correction through variational techniques. IEEE Trans. Image Process. 16(4), 1058–1072 (2007)
Choudhury, A., Medioni, G.: Perceptually motivated automatic color contrast enhancement based on color constancy estimation. EURASIP J. Image Video Process. 2010(837237), 1–22 (2010)
Ferradans, S., Bertalmío, M., Provenzi, E., Caselles, V.: An analysis of visual adaptation and contrast perception for tone mapping. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 2002–2012 (2011)
Chen, S.-H., Beghdadi, A.: Natural enhancement of color image. EURASIP J. Image Video Process. 2010(175203), 1–19 (2010)
Kim, K., Bae, J., Kim, J.: Natural HDR image tone mapping based on retinex. IEEE Trans. Consum. Electron. 57(4), 1807–1814 (2011)
Saponara, S., Fanucci, L., Marsi, S., Ramponi, G.: Algorithmic and architectural design for real-time and power-efficient retinex image/video processing. J. Real-Time Image Proc. 1(4), 267–283 (2007)
Saponara, S., Fanucci, L., Marsi, S., Ramponi, G., Kammler, D., Witte, E.M.: Application-specific instruction-set processor for retinex-like image and video processing. IEEE Transact. Circuits Syst.-II: Exp. Briefs 54(7), 596–600 (2007)
Marsi, S., Saponara, S.: Integrated video motion estimator with Retinex-like pre-processing for robust motion analysis in automotive scenarios: algorithmic and real-time architecture design. J. Real-Time Image Proc. 5(4), 275–289 (2010)
Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 267–276 (2002)
Hassan, F., Carletta, J.E.: An FPGA-based architecture for a local tone-mapping operator. J. Real-Time Image Proc. 2(4), 293–308 (2007)
Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. ACM Trans. Graph. 21(3), 249–256 (2002)
Hassan, F., Vytla, L., Carletta, J. E.: Exploiting redundancy to solve the Poisson equation using local information. In: Proceedings of IEEE International Conference on Image Processing, pp. 2689–2692 (2009)
Vytla, L., Hassan, F., Carletta, J. E.: A real-time implementation of gradient domain high dynamic range compression using a local Poisson solver. J. Real-Time Image Process, pp. 1–15 (2011). doi:10.1007/s11554-011-0198-5
Radiance homepage: http://radsite.lbl.gov/radiance/
Tao, L., Asari, V. K.: Adaptive and integrated neighborhood-dependent approach for nonlinear enhancement of color images. J. Electron. Imaging. 14(4), 043006-1–043006-14 (2005)
Tao, L., Tompkins, R., Asari, V. K.: An illuminance-reflectance model for nonlinear enhancement of color images. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 159–166 (2005)
Monobe, Y., Yamashita, H., Kurosawa, T., Kotera, H.: Dynamic range compression preserving local image contrast for digital video camera. IEEE Trans. Consum. Electron. 51(1), 1–10 (2005)
Unaldi, N., Asari, V. K., Rahman, Z.: Fast and robust wavelet-based dynamic range compression with local contrast enhancement. In: Proceedings of SPIE 6978, pp. 697805-1–697805-12 (2008)
Tsai, C.-Y., Chou, C.-H.: A novel simultaneous dynamic range compression and local contrast enhancement algorithm for digital video cameras. EURASIP J. Image Video Process. 2011(6), 1–19 (2011)
Reinhard, E., Kunkel, T., Marion, Y., Brouillat, J., Cozot, R., Bouatouch, K.: Image display algorithms for high and low dynamic range display devices. J. Soc. Inform. Disp. 15(12), 997–1014 (2007)
Marsi, S., Impoco, G., Ukovich, A., Carrato, S., Ramponi, G.: Video enhancement and dynamic range control of HDR sequences for automotive applications. EURASIP J. Adv. Signal Process. 2007(080971), 1–9 (2007)
Tsai, C.-Y., Song, K.-T.: Heterogeneity-projection hard-decision color interpolation using spectral-spatial correlation. IEEE Trans. Image Process. 16(1), 78–91 (2007)
Chen, H.-S., Chang, T.-T.: Color conversion technology of four-primary color images developed on wide color gamut red, green, blue monitor. J. Imaging Sci. Technol. 53(6), 1–10 (2009)
Hossain, M.F., Alsharif, M.R., Yamashita, K.: An approach to color image enhancement using minimum mean brightness error dynamic histogram equalization. Int. J. Innov. Comput. Inf. Control. 7(2), 827–840 (2011)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 839–846 (1998)
Garnett, R., Huegerich, T., Chui, C., He, W.: A universal noise removal algorithm with an impulse detector. IEEE Trans. Image Process. 14(11), 1747–1754 (2005)
Buades, A., Coll, B., Morel, J.-M.: Nonlocal image and movie denoising. Int. J. Comput. Vis. 76(2), 123–139 (2008)
Xiao, J.-P., Zou, X.-C., Liu, Z.-L., Guo, X.: Adaptive interpolation algorithm for real-time image resizing. In: Proceedings of the First International Conference on Innovative Computing, Information and Control, pp. 221–224 (2006)
Ramponi, G., Strobel, N.K., Mitra, S.K., Yu, T.-H.: Nonlinear unsharp masking methods for image contrast enhancement. J. Electron. Imaging 5(3), 353–366 (1996)
Kerr, D.A.: Chrominance subsampling in digital images. The Pumpkin 2012(3), 1–15 (2012)
Owens, J. D., Houston, M., Luebke, D., Green, S., Stone, J. E., Phillips, J. C.: GPU computing. In: Proceedings of the IEEE 96(5), pp. 879–899 (2008)
Fowers, J., Brown, G., Cooke, P., Stitt, G.: A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications. In: Proceedings of the ACM/SIGDA 20th International Symposium on Field Programmable Gate Arrays, pp. 47–56 (2012)
NVIDIA’s CUDA Toolkit webpage: http://www.nvidia.com/content/cuda/cuda-toolkit.html
Microsoft Windows Dev Center—Desktop webpage, DeviceIoControl function: http://msdn.microsoft.com/en-us/library/windows/desktop/aa363216(v=vs.85).aspx
Microsoft Windows Dev Center—Hardware webpage, BATTERY_STATUS structure: http://msdn.microsoft.com/en-us/library/windows/hardware/ff536290(v=vs.85).aspx
ALTERA’s DE2-70 development and education board webpage: http://www.altera.com/education/univ/materials/boards/de2-70/unv-de2-70-board.html
Chong, E. K. P., Żak, S. H.: An introduction to optimization. Wiley, New York (1996)
Acknowledgments
This study was supported by the National Science Council of Taiwan, ROC under Grant NSC 101-2221-E-032-022.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
In this Appendix, we prove that the variability range of the parameter φ is [0, Φ], where Φ is the solution of the equation \( \varphi (1 + \varepsilon )^{(\varphi - 1)} - S = 0 \) with \( S \in (0,2] \). Moreover, we justify the choice \( \varphi \in [0,\hbox{Min} (1,S)] \subseteq [0,\Upphi ] \) made in our algorithm. Let us compute the variability range of φ. First of all, we note that the normalization factor f n (x,y) defined in (5b) must be a nonzero positive value for each pixel. Hence, when applying the SDRCLCE algorithm to the intensity-transfer function (10), it has to satisfy a necessary condition such that
which guarantees that the normalization factor \( f_{n}^{{T_{2} }} (x,y) \) defined in (11) is always nonzero positive. Suppose that \( L_{\text{in}}^{\hbox{Max} } = 1 \) (i.e., normalizing the input luminance value to range [0,1]), then we have \( T_{2} (L_{\text{in}}^{\hbox{Max} } ) = 1, \)
where \( T^{\prime}_{2} \, (L_{\text{in}}^{\hbox{Max} } ) \ge 0 \) for every \( \varphi \ge 0 \) under the conditions of \( z \in [0,1] \) and \( S \in (0,2]. \) Consequently, the necessary condition (22) becomes
The above expression can further be simplified as
where the value of α can be −1 or 1. For the case of α = −1, the expression (26) becomes
As \( T^{\prime}_{2} \, (L_{\text{in}}^{\hbox{Max} } ) \ge 0 \) and \( \bar{L}_{in} (x,y) \in [0,1] \) due to the condition \( L_{\text{in}}^{\hbox{Max} } = 1 \), it is clear that the condition (26) is always satisfied for every \( \varphi \ge 0 \) when α = −1.
On the other hand, for the case of α = 1, the expression (26) becomes
This implies that the condition (26) can be satisfied if we have
Substituting (24) into (29) yields
Now, we have to compute the upper bound of the parameter φ. Let \( \eta = 1 + \varepsilon \) and \( x = (1 - \varphi )z + \varphi = z + (1 - z)\varphi \) with \( z \in [0,1] \) and \( \varphi \ge 0 \). We note that the function \( f(x): = x\eta^{(x - 1)} \) is strictly convex since its second derivative \( f^{\prime\prime}(x) = \eta^{(x - 1)} (2 + x\ln \eta )\ln \eta \) is positive for all \( x \ge 0 \). Then, from the definition of strictly convex functions, the right-hand side of the inequality (30) also satisfies the following inequality
Next, the left-hand side of (30) can be rewritten as
Observing (30), (31) and (32) finds that if the positive constant S satisfies the condition
then the following relationship is guaranteed
Expression (33) shows that the upper bound of φ is the root of the equation
For instance, if \( S = 2 \) and \( \varepsilon = {1 \mathord{\left/ {\vphantom {1 {255}}} \right. \kern-0pt} {255}} \), then the root of (34) is 1.9922 (searched by using “fzero” command in Matlab), and the range of φ can be determined as \( \varphi \in [0,1.9922] \). However, this method is too complicated to use in practice as it requires employing a one-dimensional minimization method [39] in the proposed algorithm, increasing the complexity of the implementation of the algorithm. Instead, a simpler way is that if we set \( \varphi \le 1 \), then we have \( 1 \ge \varphi \ge \varphi (1 + \varepsilon )^{(\varphi - 1)} \). Let Φ denote the root of the Eq. (34). In fact, we have \( S \le \Upphi \) for all \( S \in (0,1) \), and \( \Upphi \le S \) for all \( S \in [1,2] \). Based on the above observations, the upper bound of φ thus can be assigned as S for the case of \( S < 1 \) and assigned as 1 for the case of \( S \ge 1 \). This means that the range \( [0,\hbox{Min} (1,S)] \) is guaranteed to be a subset of range \( [0,\Upphi ] \) under the condition of \( \varphi \le 1 \) and \( S \in (0,2] \). By doing so, the process of one-dimensional minimization can be omitted while the necessary condition (22) is always satisfied. This concludes the choice of variability range \( \varphi \in [0,\hbox{Min} (1,S)] \subseteq [0,\Upphi ] \) used in our method.
Rights and permissions
About this article
Cite this article
Tsai, CY., Huang, CH. An adaptive dynamic range compression with local contrast enhancement algorithm for real-time color image enhancement. J Real-Time Image Proc 10, 255–272 (2015). https://doi.org/10.1007/s11554-012-0299-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-012-0299-9