Skip to main content
SpringerLink
Log in

Similarity metric learning for face verification using sigmoid decision function

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we consider the face verification problem, which is to determine whether two face images belong to the same subject or not. Although many research efforts have been focused on this problem, it still remains a challenging problem due to large intra-personal variations in imaging conditions, such as illumination, pose, expression, and occlusion. Our proposed method is based on the idea that we would like the similarity between positive pairs larger than negative pairs, and obtain a similarity estimation of two images. We construct our decision function by incorporating bilinear similarity and Mahalanobis distance to the sigmoid function. The constructed decision function makes our method discriminative for inter-personal differences and invariant to intra-personal variations such as pose/lighting/expression. What is more, our formulated objective function is convex, which guarantees global minimum. Our method belongs to nonlinear metric which is more robust to handle heterogeneous data than linear metric. We evaluate our proposed verification method on the challenging labeled faces in the wild (LFW) database. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods such as Joint Bayesian under the unrestricted setting of LFW.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Kumar Retna, S.M., Muneeswaran, K.: Optimal feature extraction using greedy approach for random image components and subspace approach in face recognition. J. Comput. Sci. Technol. 28(2), 322–328 (2013)

    Article  Google Scholar 

  2. Li, Y., Meng, L., Feng, J., Wu, J.: Downsampling sparse representation and discriminant information aided occluded face recognition. Sci. China Inf. Sci. 57(3), 1–9 (2014)

    Google Scholar 

  3. Wang, Z., Miao, Z., Wu, Q.M.J., Yanli, W., Zhen, T.: Low-resolution face recognition: a review. Vis. Comput. 30(4), 359–386 (2014)

    Article  Google Scholar 

  4. Singh, C., Walia, E., Mittal, N.: Robust two-stage face recognition approach using global and local features. Vis. Comput. 28(11), 1085–1098 (2012)

    Article  Google Scholar 

  5. Vieira, T.F., Bottino, A., Laurentini, A., De Simone, M.: Detecting siblings in image pairs. Vis. Comput. 30(12), 1333–1345 (2014)

    Article  Google Scholar 

  6. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  7. Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)

    Article  MATH  Google Scholar 

  8. Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans. Image Proc. 11(4), 467–476 (2002)

    Article  Google Scholar 

  9. Cao, Z., Yin, Q., Tang, X., Sun, J.: Face recognition with learning-based descriptor. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2707–2714 (2010)

  10. Huang, R., Ye, M., Xu, P., Li, T., Dou, Y.: Learning to pool high-level features for face representation. Vis. Comput. 30(1), 1–13 (2014)

    Article  Google Scholar 

  11. Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025–3032 (2013)

  12. Goldberger, J., Roweis, S., Hinton, G.: Neighbourhood components analysis. In: Advances in Neural Information Processing Systems (NIPS). pp. 513–520. MIT Press, Cambridge, MA (2005)

  13. Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? Metric learning approaches for face identification. In: IEEE 12th International Conference on Computer Vision, pp. 498–505 (2009)

  14. Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2288–2295 (2012)

  15. Cao, Q., Ying, Y., Li, P.: Similarity metric learning for face recognition. In: IEEE International Conference on Computer Vision (ICCV), pp. 2408–2415 (2013)

  16. Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Computer Vision-ECCV, pp. 566–579. Springer, Berlin (2012)

  17. Weinberger, K.Q., Blitzer, J., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. In: Advances in Neural Information Processing Systems, pp. 1473–1480 (2005)

  18. Hoi, S.C., Liu, W., Lyu, M.R., Ma, W.-Y.: Learning distance metrics with contextual constraints for image retrieval. In: Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society Conference on, pp. 2072–2078 (2006)

  19. Torresani, L., Lee, K.-C.: Large margin component analysis. In: Advances in Neural Information Processing Systems (NIPS), pp. 1385–1392. MIT Press, Cambridge, MA (2006)

  20. Shalev-Shwartz, S., Singer, Y., Ng A.Y.: Online and batch learning of pseudo-metrics. In: Proceedings of the Twenty-first International Conference on Machine Learning, p. 94 (2004)

  21. Noh, Y.K., Zhang, B.T., Lee, D.D.: Generative local metric learning for nearest neighbor classification. In: Advances in Neural Information Processing Systems (NIPS), pp. 1822–1830. MIT Press, Cambridge, MA (2010)

  22. Weinberger, K.Q., Saul, L.K.: Fast solvers and efficient implementations for distance metric learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1160–1167 (2008)

  23. Bellet, A., Habrard, A., Sebban, M.: A survey on metric learning for feature vectors and structured data. CoRR, abs/1306.6709 (2013)

  24. Qi, G.-J., Tang, J., Zha, Z.-J., Chua, T.-S., Zhang, H.-J.: An efficient sparse metric learning in high-dimensional space via l1-penalized log-determinant regularization. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 841–848 (2009)

  25. Chechik, G., Sharma, V., Shalit, U., Bengio, S.: Large scale online learning of image similarity through ranking. J. Mach. Learn. Res. 11, 1109–1135 (2010)

    MathSciNet  MATH  Google Scholar 

  26. Hosmer, D.W., Lemeshow, S.: Introduction to the logistic regression model. In: Applied Logistic Regression, 2nd edn., pp. 1–30 (2000)

  27. Davis, J.V., Brian, K., Prateek, J., Suvrit, S., Inderjit, S.D.: Information-theoretic metric learning. In: Proceedings of the Twenty-Fourth International Conference Machine Learning, pp. 209–216 (2007)

  28. Jain, P., Kulis, B., Inderjit, S.D., Kristen, G.: Online metric learning and fast similarity search. Adv. Neural Inf. Proc. Syst. 21, 761–768 (2008)

    Google Scholar 

  29. Shalev-Shwartz, S., Singer, Y., Srebro, N., Cotter, A.: Pegasos: primal estimated sub-gradient solver for svm. Math. Program. 127(1), 3–30 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  30. Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)

    Article  MathSciNet  Google Scholar 

  31. Hariharan, B., Malik, J., Ramanan, D.: Discriminative decorrelation for clustering and classification. In: Computer Vision-ECCV, pp. 459–472. Springer Berlin, Heidelberg (2012)

  32. Moghaddam, B., Jebara, T., Pentland, A.: Bayesian face recognition. Pattern Recogn. 33(11), 1771–1782 (2000)

    Article  Google Scholar 

  33. Wang, X., Tang, X.: A unified framework for subspace face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1222–1228 (2004)

    Article  Google Scholar 

  34. Taigman, Y., Wolf, L., Hassner, T. Multiple one-shots for utilizing class label information. In: BMVC, pp. 1–12 (2009)

  35. Cox, D., Pinto, N.: Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops (FG 2011), pp. 8–15 (2011)

  36. Nguyen, H. V., Bai, L.: Cosine similarity metric learning for face verification. In: Computer Vision—ACCV 2010, pp. 709–720. Springer Berlin, Heidelberg (2011)

  37. Ying, Y., Li, P.: Distance metric learning with eigenvalue optimization. J. Mach. Learn. Res. 13(1), 1–26 (2012)

    MathSciNet  MATH  Google Scholar 

  38. LFW website. http://vis-www.cs.umass.edu/lfw/results.html (2015)

  39. Li, P., Fu, Y., Mohammed, U., Elder, J.H., Prince, S.J.D.: Probabilistic models for inference about identity. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 144–157 (2012)

    Article  Google Scholar 

  40. Simonyan, K., Parkhi, O.M., Vedaldi, A., Zisserman, A.: Fisher vector faces in the wild. In: British Machine Vision Conference (BMVC) (2013)

  41. Barkan, O., Weill, J., Wolf, L., Aronowitz, H.: Fast high dimensional vector multiplication face recognition. In: IEEE International Conference on Computer Vision (ICCV), pp. 1960–1967 (2013)

  42. Sun, Y., Wang, X., Tang, X.: Hybrid deep learning for face verification. In: IEEE International Conference on Computer Vision (ICCV), pp. 1489–1496 (2013)

Download references

Acknowledgments

This work is supported by a joint project of Tencent and Shanghai Jiao Tong University. It is also partially supported by the National Basic Research 973 Program of China under Grant No. 2011CB302203, the National Natural Science Foundation of China under Grant No. 61133009, the Science and Technology Commission of Shanghai Municipality Program under Grant No. 13511505000.

Author information

Authors and Affiliations

  1. Shanghai Jiaotong University, Shanghai, China

    Xiao-Nan Hou, Shou-Hong Ding & Li-Zhuang Ma

  2. Tencent Inc., Shanghai, China

    Cheng-Jie Wang, Ji-Lin Li & Fei-Yue Huang

Authors
  1. Xiao-Nan Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shou-Hong Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Li-Zhuang Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cheng-Jie Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ji-Lin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Fei-Yue Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao-Nan Hou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, XN., Ding, SH., Ma, LZ. et al. Similarity metric learning for face verification using sigmoid decision function. Vis Comput 32, 479–490 (2016). https://doi.org/10.1007/s00371-015-1079-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-015-1079-x

Keywords

Search

Navigation