Abstract
Color helps to understand the semantic information of the image more accurately and reveals a lot more details which grayscale images cannot. By looking at an image, humans can automatically segment different objects present in an image making it easier for us to color an image. We propose a completely automated system to colorize grayscale images which learns to segment and color images in a realistic manner. We leverage the recent advancements in deep learning, Generative Adversarial Networks and improved cost functions, to overcome the problems of traditional Convolutional Neural Networks with image colorization. Given the unconstrained nature of the problem, we propose this algorithm to make a colorization model that achieves realistic colorizations. We have experimented different deep network architectures with various training algorithms and cost functions to come up with this network where we can clearly see realistic colors for given gray scale image and differentiate the characteristics of generative adversarial network from a traditional convolutional neural network.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: Proceedings of international conference on learning representations
Lisin DA, Mattar MA, Blaschko MB, Benfield MC, Learned-Mille EG (2005) Combining local and global image features for object class recognition. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), p 47. https://doi.org/10.1109/CVPR.2005.433
Ng JY-H, Yang F, Davis LS (2015) Exploiting local features from deep networks for image retrieval. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW), pp 53–61
Iizuka S, Simo-Serra E, Ishikawa H (2016) Let there be Color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans Graph (Proc SIGGRAPH 2016) 35(4)
Zhang R, Zhu J-Y, Isola P, Geng X, Lin AS, Yu T, Efros AA (2017) Real-time user-guided image colorization with learned deep priors. In: SIGGRAPH
Charpiat G, Hofmann M, Schlkopf B (2008) Automatic image colorization via multimodal predictions. In: Forsyth D, Torr P, Zisserman A (eds) ECCV 2008, Part III. LNCS, vol 5304. Springer, Heidelberg, p 126139
Chia AYS, Zhuo S, Gupta RK, Tai YW, Cho SY, Tan P, Lin S (2011) Semantic colorization with internet images. ACM Trans Graph (TOG) 30:6. ACM
Gupta RK, Chia AYS, Rajan D, Ng ES, Zhiyong H (2012) Image colorization using similar images. In: Proceedings of the 20th ACM international conference on multimedia. ACM
Irony R, Cohen-Or D, Lischinski D (2005) Colorization by example. In: Eurographics symposium on rendering
Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. In: SIG-GRAPH
Sapiro G (2005) Inpainting the colors. In: IEEE international conference on image processing (ICIP). Genova
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
Wang X, Gupta A (2016) Generative image modeling using style and structure adversarial networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision ECCV 2016. Lecture notes in computer science, vol 9908. Springer, Cham
Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv:1411.1784
Hariharan B, Arbelaez P, Girshick R (2015) Hypercolumns for object segmentation and fine-grained localization. In: Proceedings of conference on computer vision and pattern recognition (CVPR)
Goodfellow I (2016) NIPS 2016 tutorial: generative adversarial networks. arXiv:1701.00160
Dahl R (2016) Automatic colorization. http://tinyclouds.org/colorize. Accessed 30 Aug 20108
Nazeri K, Ng E, Ebrahimi M (2018) Image colorization with generative adversarial networks. In: Perales F, Kittler J (eds) Articulated motion and deformable objects. AMDO 2018. Lecture notes in computer science, vol 10945. Springer, Cham. arXiv:1803.05400
Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality, stability, and variation. In: Proceeedings of international conference on learning representations (ICLR). Vancouver
Zhou B, Lapedriza A, Khosla A, Oliva A, Torralba A (2017) Places: a 10 million image database for scene recognition. IEEE Trans Pattern Anal Mach Intell (ICLR) 40:1452–1464. https://doi.org/10.1109/TPAMI.2017.2723009
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Teja Yalakuntla, V., Kanojia, R., Chauhan, K., Gurnani, R., Zaveri, M.A. (2020). Surpassing Traditional Image-Colorization Problems with Conditional Generative Adversarial Networks. In: Hitendra Sarma, T., Sankar, V., Shaik, R. (eds) Emerging Trends in Electrical, Communications, and Information Technologies. Lecture Notes in Electrical Engineering, vol 569. Springer, Singapore. https://doi.org/10.1007/978-981-13-8942-9_4
Download citation
DOI: https://doi.org/10.1007/978-981-13-8942-9_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-8941-2
Online ISBN: 978-981-13-8942-9
eBook Packages: EngineeringEngineering (R0)