Advertisement

Face Sketch Recognition via Data-Driven Synthesis

  • Nannan Wang
  • Shengchuan Zhang
  • Chunlei Peng
  • Jie Li
  • Xinbo Gao
Chapter
Part of the Advances in Computer Vision and Pattern Recognition book series (ACVPR)

Abstract

In some real-world scenarios, there does not always exist a normal photo for face recognition or retrieval purpose, e.g. suspect searching for law enforcement. Under the circumstances, a sketch drawn by the artist is usually taken as the substitute for matching with the mug shot photos collected by the police office. However, due to the great discrepancy of the texture presentation between sketches and photos, common face recognition methods achieve limited performance on this task. In order to shrink this gap, sketches can be transformed to photos relying on some machine learning techniques and then synthesized photos are utilized to match with mug shot photos. Alternatively, photos can also be transformed to sketches and the probe sketch drawn by the artist is matched with the transformed sketches subsequently. Existing learning-based face sketch–photo synthesis methods are grouped into two major categories: data-driven methods (example-based methods) and model-based methods. This chapter would give a comprehensive analysis and comparison to advances on this topic.

Keywords

Data-driven Face sketch synthesis Sparse representation Probabilistic graphical model 

Notes

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (under Grant 61501339 and 61671339).

References

  1. 1.
    Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 24(9):1167–1183CrossRefGoogle Scholar
  2. 2.
    Chang L, Zhou M, Deng X, Han Y (2011) Face sketch synthesis via multivariate output regression. In: Proceedings of international conference on human-computer interaction, pp 555–561Google Scholar
  3. 3.
    Chang L, Zhou M, Han Y, Deng X (2010) Face sketch synthesis via sparse representation. In: Proceedings of international conference on pattern recognition, pp 2146–2149Google Scholar
  4. 4.
    Chen L, Liao H, Ko M, Lin J, Yu G (2000) A new lda-based face recognition system which can solve the small sample size problem. Pattern Recognit 33(10):1713–1726CrossRefGoogle Scholar
  5. 5.
    Elad M, Aharon M (2006) Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans Image Process 15(12):3736–3745MathSciNetCrossRefGoogle Scholar
  6. 6.
    Gao X, Wang N, Tao D, Li X (2012) Face sketch-photo synthesis and retrieval using sparse representation. IEEE Trans Circuits Syst Video Technol 22(8):1213–1226CrossRefGoogle Scholar
  7. 7.
    Gao X, Zhong J, Li J, Tian C (2008) Face sketch synthesis algorithm using e-hmm and selective ensemble. IEEE Trans Circuits Syst Video Technol 18(4):487–496CrossRefGoogle Scholar
  8. 8.
    Gao X, Zhong J, Tao D, Li X (2008) Local face sketch synthesis learning. Neurocomputing 71(10–12):1921–1930CrossRefGoogle Scholar
  9. 9.
    Geng B, Tao D, Xu C, Yang L, Hua X (2012) Ensemble manifold regularization. IEEE Trans Pattern Anal Mach Intell 34(6):1227–1233CrossRefGoogle Scholar
  10. 10.
    Li X, Cao X (2012) A simple framework for face photo-sketch synthesis. Math Probl Eng:1–19Google Scholar
  11. 11.
    Liu Q, Tang X, Jin H, Lu H, Ma S (2005) A nonlinear approach for face sketch synthesis and recognition. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1005–1010Google Scholar
  12. 12.
    Mairal J, Sapiro G, Elad M (2008) Learning multiscale sparse representations for image and video restoration. SIAM Multiscale Model Simul 17:214–241MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Martinez A, Benavente R (1998) The ar face database. Technical report, CVC Technical Report #24Google Scholar
  14. 14.
    Messer K, Matas J, Kittler J, Luettin J, Maitre G (1999) Xm2vtsdb: the extended m2vts database. In: Proceedings of international conference on audio- and video-based biometric person authentication, pp 72–77Google Scholar
  15. 15.
    Peng C, Gao X, Wang N, Tao D, Li X, Li J (2015) Multiple representations based face sketch-photo synthesis. IEEE Trans Neural Netw Learn Syst:1–13Google Scholar
  16. 16.
    Tang X, Wang X (2002) Face photo recognition using sketches. In: Proceedings of IEEE international conference on image processing, pp 257–260Google Scholar
  17. 17.
    Tang X, Wang X (2003) Face sketch synthesis and recognition. In: Proceedings of IEEE international conference on computer vision, pp 687–694Google Scholar
  18. 18.
    Tang X, Wang X (2004) Face sketch recognition. IEEE Trans Circuits Syst Video Technol 14(1):1–7CrossRefGoogle Scholar
  19. 19.
    Turk M, Pentland A (1991) Face recognition using eigenfaces. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 586–591Google Scholar
  20. 20.
    Wang N, Li J, Tao D, Li X, Gao X (2013) Heterogeneous image transformation. Pattern Recognit Lett 34(1):77–84CrossRefGoogle Scholar
  21. 21.
    Wang N, Tao D, Gao X, Li X, Li J (2013) Transductive face sketch-photo synthesis. IEEE Trans Neural Netw Learn Syst 24(9):1364–1376CrossRefGoogle Scholar
  22. 22.
    Wang N, Tao D, Gao X, Li X, Li J (2014) A comprehensive survey to face hallucination. Int J Comput Vision 106(1):9–30CrossRefGoogle Scholar
  23. 23.
    Wang S, Zhang L, Liang Y, Pan Q (2012) Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 2216–2223Google Scholar
  24. 24.
    Wang X, Tang X (2009) Face photo-sketch synthesis and recognition. IEEE Trans Pattern Anal Mach Intell 31(11):1955–1967CrossRefGoogle Scholar
  25. 25.
    Xiao B, Gao X, Tao D, Li X (2009) A new approach for face recognition by sketches in photos. Signal Process 89(8):1576–1588CrossRefzbMATHGoogle Scholar
  26. 26.
    Xiao B, Gao X, Tao D, Yuan Y, Li J (2010) Photo-sketch synthesis and recognition based on subspace learning. Neurocomputing 73(4–6):840–852CrossRefGoogle Scholar
  27. 27.
    Yang J, Wright J, Huang T, Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8Google Scholar
  28. 28.
    Zhang S, Gao X, Wang N, Li J, Zhang M (2015) Face sketch synthesis via sparse representation-based greedy search. IEEE Trans Image Process 24(8):2466–2477MathSciNetCrossRefGoogle Scholar
  29. 29.
    Zhang W, Wang X, Tang X (2010) Lighting and pose robust face sketch synthesis. In: Proceedings of European conference on computer vision, pp 420–423Google Scholar
  30. 30.
    Zhao W, Chellappa R, Phillips P, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRefGoogle Scholar
  31. 31.
    Zhong J, Gao X, Tian C (2007) Face sketch synthesis using e-hmm and selective ensemble. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing, pp 485–488Google Scholar
  32. 32.
    Zhou H, Kuang Z, Wong K (2012) Markov weight fields for face sketch synthesis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1091–1097Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Nannan Wang
    • 1
  • Shengchuan Zhang
    • 2
  • Chunlei Peng
    • 2
  • Jie Li
    • 2
  • Xinbo Gao
    • 2
  1. 1.State Key Laboratory of Integrated Services Networks, School of Telecommunications EngineeringXidian UniversityXi’anPeople’s Republic of China
  2. 2.Lab of Video & Image Processing Systems, School of Electronic EngineeringXidian UniversityXi’anPeople’s Republic of China

Personalised recommendations