Weakly-Supervised Dual Generative Adversarial Networks for Makeup-Removal

  • Xuedong Hou
  • Yun Li
  • Tao Li
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10635)


With the improvement of face recognition precision, face recognition system is used in many fields. However, the face recognition system sometimes cannot recognize the makeup face. In this paper, a new image-to-image translation algorithm based on GAN and dual learning is proposed to remove the makeup. Especially, the proposed algorithm is weakly supervised and it combines the paired and unpaired image-to-image translation model. The dual model is firstly trained using a small number of paired data, then the performance of the model is improved by large number of unpaired data. The proposed weakly-supervised image-to-image translation algorithm is applied into makeup-removal task, and the experimental results demonstrate its higher performance than other algorithms.


Image-to-image translation Dual learning GAN Makeup-removal 



This research was partially supported by National Natural Science Foundation of China (NSFC 61603197), Natural Science Foundation of Jiangsu Province (BK20140885) and NUPTSF (NY2141).


  1. 1.
    Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)
  2. 2.
    Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A.,Totz, J., Wang, Z.: Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint arXiv:1609.04802 (2016)
  3. 3.
    Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., Efros, A.A.: Context encoders: feature learning by inpainting. In: IEEE Conference on Computer Vision and Patten Recognition (2016)Google Scholar
  4. 4.
    Zhu, J.Y., Krahenbuhl, P., Shechtman, E., Efros, A.A.: Generative visual manipulation on the natural image manifold. In: European Conference on Computer Vision (2016)Google Scholar
  5. 5.
    Mathieu, M., Couprie, C., LeCun, Y.: Deep multiscale video prediction beyond mean square error. In: International Conference on Learning Representations (2016)Google Scholar
  6. 6.
    Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image to-image translation with conditional adversarial networks. arXiv preprint arXiv:1611.07004 (2016)
  7. 7.
    Liu, M.Y., Tuzel, O.: Coupled generative adversarial networks. In: Neural Information Processing Systems, pp. 469–477 (2016)Google Scholar
  8. 8.
    Yi, Z., Zhang, H., Tan, P., Gong, M.: DualGAN: Unsupervised Dual Learning for Image-to-Image Translation. arXiv preprint arXiv:1704.02510 (2017)
  9. 9.
    Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. arXiv preprint arXiv:1703.10593 (2017)
  10. 10.
    Kim, T., Cha, M., Kim, H., Lee, J.K., Kim, J.: Learning to Discover cross-domain relations with generative adversarial networks. In: International Conference on Machine Learning (2017)Google Scholar
  11. 11.
    Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio. Y.: Generative adversarial nets. In: Neural Information Processing Systems, pp. 2672–2680 (2014)Google Scholar
  12. 12.
    Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)
  13. 13.
    Wu, H., Zheng, S., Zhang, J., Huang, K.: GP-GAN: Towards Realistic High-Resolution Image Blending. arXiv preprint arXiv:1703.07195 (2017)
  14. 14.
    Xia, Y., He, D., Qin, T., Wang, L., Yu, N., Liu, T.Y., Ma, W.Y.: Dual learning for machine translation. arXiv preprint arXiv:1611.00179 (2016)
  15. 15.
    TAAZ Homepage, Accessed 5 June 2017
  16. 16.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, William M., Frangi, Alejandro F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi: 10.1007/978-3-319-24574-4_28 CrossRefGoogle Scholar
  17. 17.
    Li, C., Wand, M.: Precomputed real-time texture synthesis with markovian generative adversarial networks. In: European Conference on Computer Vision (2016)Google Scholar
  18. 18.
    Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z.: Multiclass generative adversarial networks with the l2 loss function. arXiv preprint arXiv:1611.04076 (2016)
  19. 19.
    Tieleman, T., Hinton, G.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2) (2014) Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.School of Computer SciencesNanjing University of Posts and TelecommunicationsNanjingChina
  2. 2.Jiangsu Key Laboratory of Big Data Security and Intelligent ProcessingNanjing University of Posts and TelecommunicationsNanjingChina

Personalised recommendations