Abstract
In this work, a novel and generic method for example-based color transfer is presented. The color transfer is formulated in two steps: first, an example-based Chromatic Adaptation Transform (CAT) has been designed to obtain an illuminant matching between input and example images. Second, the dominant colors of the input and example images are optimally mapped. The main strength of the method comes from using optimal transportation to map a pair of meaningful color palettes, and regularizing this mapping through thin plate splines. In addition, we show that additional visual or semantic constraints can be seamlessly incorporated to obtain a consistent color mapping. Experiments have shown that the proposed method outperforms state-of-the-art techniques for challenging images. In particular, color mapping artifacts have been objectively assessed by the Structural Similarity (SSIM) measure [26], showing that the proposed approach preserves structures while transferring color. Finally, results on video color transfer show the effectiveness of the method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Many CAT matrices exist in literature, such as CAT02, Bradford, CMCCAT2000, Sharp, etc. The state-of-the-art CAT02 transformation matrix [14] is used in our work.
- 2.
Implementation available in the OpenCV library. http://opencv.org/.
References
Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989)
Chiou, W.C., Chen, Y.L., Hsu, C.T.: Color transfer for complex content images based on intrinsic component. In: IEEE Multimedia Signal Processing, pp. 156–161 (2010)
Cusano, C., Gasparini, F., Schettini, R.: Color transfer using semantic image annotation. In: IS&T/SPIE Electronic Imaging, International Society for Optics and Photonics, pp. 82990U–82990U-8 (2012)
Delon, J., Desolneux, A., Lisani, J.L., Petro, A.: A nonparametric approach for histogram segmentation. IEEE Trans. Image Process. 16, 253–261 (2007)
Ferradans, S., Papadakis, N., Rabin, J., Peyré, G., Aujol, J.-F.: Regularized discrete optimal transport. In: Pack, T. (ed.) SSVM 2013. LNCS, vol. 7893, pp. 428–439. Springer, Heidelberg (2013)
Freedman, D., Kisilev, P.: Object-to-object color transfer: optimal flows and smsp transformations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 287–294 (2010)
HaCohen, Y., Shechtman, E., Goldman, D.B., Lischinski, D.: Non-rigid dense correspondence with applications for image enhancement. ACM Trans. Graph. 30, 70:1–70:10 (2011)
HaCohen, Y., Shechtman, E., Goldman, D.B., Lischinski, D.: Optimizing color consistency in photo collections. ACM Trans. Graph. 32, 1–10 (2013)
Huo, J.y., Chang, Y.l., Wang, J., Wei, X.x.: Robust automatic white balance algorithm using gray color points in images. IEEE Trans. Consum. Electron. 52, 541–546 (2006)
Hwang, Y., Lee, J.Y., So Kweon, I., Joo Kim, S.: Color transfer using probabilistic moving least squares. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3342–3349 (2014)
Jiang, J., Gu, J.: An exemplar-based method for automatic visual editing and retouching of fine art reproduction. In: Color and Imaging Conference, pp. 85–91 (2013)
Le Meur, O., Le Callet, P., Barba, D., Thoreau, D.: A coherent computational approach to model bottom-up visual attention. IEEE Pattern Anal. Mach. Intell. 28, 802–817 (2006)
Lindner, A., Shaji, A., Bonnier, N., Süsstrunk, S.: Joint statistical analysis of images and keywords with applications in semantic image enhancement. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 489–498 (2012)
Moroney, N., Fairchild, M.D., Hunt, R.W.G., Li, C., Luo, M.R., Newman, T.: The CIECAM02 color appearance model. In: Color and Imaging Conference, pp. 23–27 (2002)
Murray, N., Skaff, S., Marchesotti, L., Perronnin, F.: Toward automatic and flexible concept transfer. Comput. Graph. 36, 622–634 (2012)
Neumann, L., Neumann, A.: Color style transfer techniques using hue, lightness and saturation histogram matching. In: Computational Aesthetics in Graphics, Visualization and Imaging, pp. 111–122 (2005)
Papadakis, N., Provenzi, E., Caselles, V.: A variational model for histogram transfer of color images. IEEE Trans. Image Process. 20, 1682–1695 (2011)
Pitié, F., Kokaram, A.C., Dahyot, R.: Automated colour grading using colour distribution transfer. Comput. Vis. Image Underst. 107, 123–137 (2007)
Pouli, T., Reinhard, E.: Progressive color transfer for images of arbitrary dynamic range. Comput. Graph. 35, 67–80 (2011)
Rabin, J., Delon, J., Gousseau, Y.: Removing artefacts from color and contrast modifications. IEEE Trans. Image Process. 20, 3073–3085 (2011)
Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. IEEE Comput. Graph. Appl. 21, 34–41 (2001)
Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vision 40, 99–121 (2000)
Sheikh Faridul, H., Stauder, J., Kervec, J., Tremeau, A.: Approximate cross channel color mapping from sparse color correspondences. In: The IEEE International Conference on Computer Vision (ICCV) Workshops (2013)
Tai, Y.W., Jia, J., Tang, C.K.: Local color transfer via probabilistic segmentation by expectation-maximization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 747–754 (2005)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57, 137–154 (2004)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)
Wu, F., Dong, W., Kong, Y., Mei, X., Paul, J.C., Zhang, X.: Content-based colour transfer. Comput. Graph. Forum 32, 190–203 (2013)
Xu, W., Mulligan, J.: Performance evaluation of color correction approaches for automatic multi-view image and video stitching. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 263–270 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Frigo, O., Sabater, N., Demoulin, V., Hellier, P. (2015). Optimal Transportation for Example-Guided Color Transfer. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9005. Springer, Cham. https://doi.org/10.1007/978-3-319-16811-1_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-16811-1_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16810-4
Online ISBN: 978-3-319-16811-1
eBook Packages: Computer ScienceComputer Science (R0)