Automatic Natural Image Colorization

  • Tan-Bao TranEmail author
  • Thai-Son TranEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12033)


We introduce a technique to automatically colorize natural grayscale images that combines both local and global features. Automatic colorization is a hard problem of computer vision and usually requires user interactions such as human-labelled color scribbles or reference images to achieve proper results. Based on Convolutional Neural Networks (CNN), our model is trained in an end-to-end fashion and can process images of any resolution. We improve the model of Iizuka et al. [1] by adding edge detection network and adjusting the input of the loss function. We also compare our model with the state of the art and show some improvements. Furthermore, we try colorizing ink wash paintings and achieve a special style.


Colorization Convolutional Neural Network Self-supervised learning 



This research was supported, in part, by Ngoc Dung Beauty Center. We thank members of Ngoc Dung AI Lab for helpful discussions and Duy-Phu Nguyen for his helpful advice.


  1. 1.
    Iizuka, S., Simo-Serra, E., Ishikawa, H.: Let there be color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans. Graph. 35(4), 1–11 (2016)CrossRefGoogle Scholar
  2. 2.
    Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. 23(3) (2004)Google Scholar
  3. 3.
    Huang, Y.-C., Tung, Y.-S., Chen, J.-C., Wang, S.-W., Wu, J.-L.: An adaptive edge detection based colorization algorithm. In: ACM International Conference on Multimedia (2005)Google Scholar
  4. 4.
    Luan, Q., Wen, F., Cohen-Or, D., Liang, L., Xu, Y.-Q., Shum, H.-Y.: Natural image colorization. In: Eurographics Conference on Rendering Techniques (2007)Google Scholar
  5. 5.
    Welsh, T., Ashikhmin, M., Mueller, K.: Transferring color to greyscale images. ACM Trans. Graph. 21(3) (2002)Google Scholar
  6. 6.
    Chia, A.-S., et al.: Semantic colorization with internet images. ACM Trans. Graph. 30(6), 1–8 (2011)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Larsson, G., Maire, M., Shakhnarovich, G.: Learning representations for automatic colorization. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 577–593. Springer, Cham (2016). Scholar
  8. 8.
    Zhang, R., Isola, P., Efros, A.A.: Colorful image colorization. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 649–666. Springer, Cham (2016). Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.University of ScienceVietnam National UniversityHo Chi Minh CityVietnam

Personalised recommendations