Face Composite Sketch Recognition by BoVW-Based Discriminative Representations

  • Yenisel Plasencia-Calaña
  • Heydi Méndez-Vázquez
  • Rainer Larin Fonseca
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10125)

Abstract

Face sketches are one of the main sources used for criminal investigation. In this paper, we propose a new approach for the recognition of facial composite sketches. We propose the use of discriminative representations as a way to bridge the modality gap between sketches and mug-shot photos. The intermediate representation is based on the bag-of-visual-words (BoVW) approach using dense SIFT features on multiple scales. Next, a discriminative representation is computed on top of the intermediate representation. Experimental results show that the discriminative representations outperform state-of-the-art approaches for this task in composite sketch datasets for both a close-set scenario as well as an open-set recognition scenario.

Keywords

Composite sketch recognition Discriminative representations Bag-of-visual-words Metric learning Modality gap 
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRefGoogle Scholar
  2. 2.
    Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 566–579. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-33712-3_41 CrossRefGoogle Scholar
  3. 3.
    Duin, R., Juszczak, P., Paclik, P., Pekalska, E., de Ridder, D., Tax, D., Verzakov, S.: PR-Tools4.1, a matlab toolbox for pattern recognition. Technical report, Information and Communication Theory Group: Delft University of Technology, The Netherlands (2007). http://www.prtools.org/
  4. 4.
    Han, H., Klare, B., Bonnen, K., Jain, A.K.: Matching composite sketches to face photos: a component-based approach. IEEE Trans. Inf. Forensics Secur. 8(1), 191–204 (2013)CrossRefGoogle Scholar
  5. 5.
    Klare, B., Jain, A.K.: Sketch-to-photo matching: a feature-based approach. SPIE Defense, Security, and Sensing, vol. 7667 (2010)Google Scholar
  6. 6.
    Klare, B., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRefGoogle Scholar
  7. 7.
    Klum, S., Han, H., Jain, A.K., Klare, B.: Sketch based face recognition: forensic vs. composite sketches. In: International Conference on Biometrics, ICB 2013, Madrid, Spain, 4–7 June 2013, pp. 1–8 (2013)Google Scholar
  8. 8.
    Klum, S., Han, H., Klare, B., Jain, A.K.: The facesketchid system: matching facial composites to mugshots. IEEE Trans. Inf. Forensics Secur. 9(12), 2248–2263 (2014)CrossRefGoogle Scholar
  9. 9.
    Köstinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, pp. 2288–2295 (2012)Google Scholar
  10. 10.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, vol. 2. pp. 2169–2178. IEEE Computer Society, Washington, DC (2006)Google Scholar
  11. 11.
    Mittal, P., Jain, A., Singh, R., Vatsa, M.: Boosting local descriptors for matching composite and digital face images. In: 2013 IEEE International Conference on Image Processing, pp. 2797–2801, September 2013Google Scholar
  12. 12.
    Mittal, P., Jain, A., Goswami, G., Singh, R., Vatsa, M.: Recognizing composite sketches with digital face images via SSD dictionary. In: IEEE International Joint Conference on Biometrics, IJCB 2014, Clearwater, FL, USA, 29 September–2 October 2014, pp. 1–6 (2014)Google Scholar
  13. 13.
    Mittal, P., Vatsa, M., Singh, R.: Composite sketch recognition via deep network - a transfer learning approach. In: International Conference on Biometrics, ICB 2015, Phuket, Thailand, 19–22 May 2015, pp. 251–256 (2015)Google Scholar
  14. 14.
    Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1469–1472. ACM, New York (2010)Google Scholar
  15. 15.
    Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)CrossRefGoogle Scholar
  16. 16.
    Yuen, P.C., Man, C.H.: Human face image searching system using sketches. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 37(4), 493–504 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Yenisel Plasencia-Calaña
    • 1
  • Heydi Méndez-Vázquez
    • 1
  • Rainer Larin Fonseca
    • 1
  1. 1.Advanced Technologies Application CenterPlayaCuba

Personalised recommendations