Multimedia Tools and Applications

, Volume 77, Issue 11, pp 13753–13771 | Cite as

Scribble-based gradient mesh recoloring

  • Liang Wan
  • Yi Xiao
  • Ning Dou
  • Chi-Sing Leung
  • Yu-Kun Lai


Previous gradient mesh recoloring methods usually have dependencies on an additional reference image and the rasterized gradient mesh. To circumvent such dependencies, we propose a user scribble-based recoloring method, in which users are allowed to annotate gradient meshes with a few color scribbles. Our approach builds an auxiliary mesh from gradient meshes, namely control net, by taking both colors and local color gradients at mesh points into account. We then develop an extended chrominance blending method to propagate the user specified colors over the control net. The recolored gradient mesh is finally reconstructed from the recolored control net. Experiments validate the effectiveness of our approach on multiple gradient meshes. Compared with various alternative solutions, our method has no color bleedings nor sampling artifacts, and can achieve fast performance.


Gradient mesh Recoloring by scribble Control net Scribble point set 



The authors want to thank the reviewers for their valuable suggestions. The work is supported by NSFC from PRC (Project Num.:61572354, 61502158), GRF from Hong Kong (Project Num.:CityU 11259516), Fundamental Research Funds for the Central Universities (Project Num.:531107040842), and Hunan NSF (Project Num.:2017JJ3042).


  1. 1.
    Abadpour A, Kasaei S (2007) An efficient pca-based color transfer method. J Vis Commun Image Represent 18(1):15-34CrossRefGoogle Scholar
  2. 2.
    An X, Pellacini F (2010) User-controllable color transfer. Comput Graphics Forum 29(2):263-271CrossRefGoogle Scholar
  3. 3.
    Drew MS, Finlayson GD (2008) Realistic colorization via the structure tensor 15th IEEE international conference on image processing, pp 457-460Google Scholar
  4. 4.
    Ferguson J (1964) Multivariable curve interpolation. J ACM 11(2):221-228MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Forrest W (2014)
  6. 6.
  7. 7.
    Horiuchi T, Kotera H (2005) Colorization for monochrome image with texture Color imaging conference, pp 245-250Google Scholar
  8. 8.
    Huang Y-C, Tung Y-S, Chen J-C, Wang S-W, Wu J-L (2005) An adaptive edge detection based colorization algorithm and its applications. ACM, New York, pp 351-354Google Scholar
  9. 9.
    Irony R, Cohen-Or D, Lischinski D (2005) Colorization by example Rendering techniques, pp 201-210Google Scholar
  10. 10.
    Kawulok M, Kawulok J, Smolka B (2011) Textural features for scribble-based image colorization. Comput Recognit Syst 4(95):269-278CrossRefGoogle Scholar
  11. 11.
    Kawulok M, Smolka B (2010) Competitive image colorisation Proceedings of 17th international conference on image processing, pp 405-408Google Scholar
  12. 12.
    Lai Y-K, Hu S-M, Martin RR (2009) Automatic and topology-preserving gradient mesh generation for image vectorization. ACM Trans Graph 28(3):1-8CrossRefGoogle Scholar
  13. 13.
    Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. ACM Trans Graph 23(3):689-694CrossRefGoogle Scholar
  14. 14.
    Liu X-P, Wan L, Qu Y-G, Wong T-T, Lin S, Leung C-S, Heng P-A (2008) Intrinsic colorization. ACM Trans Graph 27(5):1-9CrossRefGoogle Scholar
  15. 15.
    Luan Q, Wen F, Cohen-Or D, Liang L, Xu Y-Q, Shum H-Y (2007) Natural image colorization Rendering techniques 2007 (Proceedings Eurographics Symposium on Rendering). EurographicsGoogle Scholar
  16. 16.
    Miao Z, Zhang Y, Zheng Z, Sun Z (2016) Image palette: painting style transfer via brushstroke control synthesis. Multimedia Tools and Applications, pp 1-22Google Scholar
  17. 17.
    Morisaki T (2014)
  18. 18.
    Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34-41CrossRefGoogle Scholar
  19. 19.
    Sapiro G (2005) Inpainting the colors Proceedings of IEEE international conference on image processing, vol 2, pp 698-701Google Scholar
  20. 20.
    Seo S, Park YS, Ostromoukhov V (2013) Image recoloring using linear template mapping. Multimed Tool Appl 64(2):293-308CrossRefGoogle Scholar
  21. 21.
    Su Z, Deng D, Yang X, Luo X (2012) Color transfer based on multiscale gradient-aware decomposition and color distribution mapping Proceedings of the 20th ACM international conference on Multimedia, MM '12. ACM, New York, pp 753-756CrossRefGoogle Scholar
  22. 22.
    Su Z, Zeng K, Liu L, Li B, Luo X (2014) Corruptive artifacts suppression for example-based color transfer. IEEE Trans Multimedia 16(4):988-999CrossRefGoogle Scholar
  23. 23.
    Sun J, Liang L, Wen F, Shum H-Y (2007) Image vectorization using optimized gradient meshes. ACM Trans Graph 26(3):11CrossRefGoogle Scholar
  24. 24.
    Tai Y-W, Jia J-Y, Tang C-K (2005) Local color transfer via probabilistic segmentation by expectation-maximization Proceedings of the 2005 IEEE conference on computer vision and pattern recognition, volume 1, pp 747-754, Washington, DC, USAGoogle Scholar
  25. 25.
    Wen C-L, Hsieh C-H, Chen B-Y, Ouhyoung M (2008) Example-based multiple local color transfer by strokes. Comput Graphics Forum 27(7):1765-1772CrossRefGoogle Scholar
  26. 26.
    Xiao Y, Wan L, Leung C-S, Lai Y-K, Wong T-T (2013) Example-based color transfer for gradient meshes. IEEE Trans Multimedia 15(3):549-560CrossRefGoogle Scholar
  27. 27.
    Xiao Y, Wan L, Leung C-S, Lai Y-K, Wong T-T (2015) Optimization-based gradient mesh colour transfer. Comput Graphics Forum 34(6):123-134CrossRefGoogle Scholar
  28. 28.
    Yang Y, Zhao H, You L, Tu R, Wu X, Jin X (2015) Semantic portrait color transfer with internet images. Multimedia Tools and Applications, pp 1-19Google Scholar
  29. 29.
    Yao C, Yang X, Chen L, Xu Y (2011) Image colorization using bayesian nonlocal inference. J Electron Imaging 20(2):023008-1-023008-6CrossRefGoogle Scholar
  30. 30.
    Yatziv L, Sapiro G (2006) Fast image and video colorization using chrominance blending. IEEE Trans Image Process 15(5):1120-1129CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  1. 1.Tianjin UniversityTianjinChina
  2. 2.Hunan UniversityChangshaChina
  3. 3.City University of Hong KongKowloonHong Kong
  4. 4.Cardiff UniversityCardiffUK

Personalised recommendations