Using Deep Relational Features to Verify Kinship

  • Jingyun Liang
  • Jinlin Guo
  • Songyang Lao
  • Jue Li
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 771)


Kinship verification from facial images is a very challenging research topic. Differing from most of previous methods focusing on calculating a similarity metric, in this work, we utilize convolutional neural network and autoencoder to learn deep relational features for verifying kinship from facial images. Specifically, we firstly train a convolutional neural network to extract representative facial features, which derive from the last fully-connected layer in network. Then, facial features from two person are set as two ends of an autoencoder respectively, and relational features are extracted from the middle layer of the trained autoencoder. Finally, SVM classifiers are adopted to verify kinship (e.g., Father-Son). Experimental results on two public datasets show the effectiveness of the approach proposed in this work.


Kinship verification Convolutional neural network Autoencoder Relational feature 


  1. 1.
    Ashalatha, M.E., Holi, M.S., Mirajkar, P.R.: Face recognition using local features by LPP approach. In: Proceedings of International Circuits, Communication, Control and Computing (I4C) Conference, pp. 382–386, November 2014Google Scholar
  2. 2.
    Eckert, M., Gil, A., Zapatero, D., Meneses, J., Ortega, J.F.M.: Fast facial expression recognition for emotion awareness disposal. In: 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin) (2016)Google Scholar
  3. 3.
    Fang, R., Tang, K.D., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: Proceedings of IEEE International Conference on Image Processing, pp. 1577–1580, September 2010Google Scholar
  4. 4.
    Guo, G., Wang, X.: Kinship measurement on salient facial features. IEEE Trans. Instrum. Meas. 61(8), 2322–2325 (2012)CrossRefGoogle Scholar
  5. 5.
    Hackman, L., Black, S.M.: Age estimation in the living. In: Encyclopedia of Forensic & Legal Medicine, pp. 34–40 (2016)Google Scholar
  6. 6.
    Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, vol. 25, no. 2 (2012)Google Scholar
  8. 8.
    Lu, J., Zhou, X., Tan, Y.P., Shang, Y., Zhou, J.: Neighborhood repulsed metric learning for kinship verification. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 331–345 (2014)CrossRefGoogle Scholar
  9. 9.
    Lu, J., Hu, J., Zhou, X., Shang, Y., Tan, Y.P., Wang, G.: Neighborhood repulsed metric learning for kinship verification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2594–2601 (2012)Google Scholar
  10. 10.
    Lu, J., Hu, J., Zhou, X., Zhou, J., Castrillon-Santana, M., Lorenzo-Navarro, J., Kou, L., Shang, Y., Bottino, A., Vieira, T.F.: Kinship verification in the wild: the first kinship verification competition. In: IJCB 2014–2014 IEEE/IAPR International Joint Conference on Biometrics (2014)Google Scholar
  11. 11.
    Ranzato, M., Huang, F.J., Boureau, Y., Lecun, Y.: Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8 (2007)Google Scholar
  12. 12.
    Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Sun, Y., Wang, X., Tang, X.: Deep learning face representation from predicting 10,000 classes, pp. 1891–1898 (2014)Google Scholar
  14. 14.
    Wolf, L., Hassner, T., Maoz, I.: Face recognition in unconstrained videos with matched background similarity. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 529–534, June 2011Google Scholar
  15. 15.
    Xia, S., Shao, M., Fu, Y.: Kinship verification through transfer learning. In: IJCAI International Joint Conference on Artificial Intelligence, pp. 2539–2544 (2011)Google Scholar
  16. 16.
    Xia, S., Shao, M., Luo, J., Fu, Y.: Understanding kin relationships in a photo. IEEE Trans. Multimedia 14(4 PART1), 1046–1056 (2012). CrossRefGoogle Scholar
  17. 17.
    Yan, H.: Kinship verification using neighborhood repulsed correlation metric learning. Image Vis. Comput. (2016).
  18. 18.
    Yan, H., Lu, J., Deng, W., Zhou, X.: Discriminative multimetric learning for kinship verification. IEEE Trans. Inf. Forensics Secur. 9(7), 1169–1178 (2014)CrossRefGoogle Scholar
  19. 19.
    Zhang, K., Huang, Y., Song, C., Wu, H., Wang, L.: Kinship verification with deep convolutional neural networks. BMVC 2015, 1–12 (2015)Google Scholar
  20. 20.
    Zhou, X., Hu, J., Lu, J., Shang, Y., Guan, Y.: Kinship verification from facial images under uncontrolled conditions. In: International Conference on Multimedia 2011, Scottsdale, AZ, USA, 28 November - 01 December, pp. 953–956 (2011)Google Scholar
  21. 21.
    Zhou, X., Shang, Y., Yan, H., Guo, G.: Ensemble similarity learning for kinship verification from facial images in the wild. Inf. Fusion 32, 40–48 (2016). CrossRefGoogle Scholar
  22. 22.
    Zhou, X., Yan, H., Shang, Y.: Kinship verification from facial images by scalable similarity fusion. Neurocomputing 197, 136–142 (2016). CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2017

Authors and Affiliations

  • Jingyun Liang
    • 1
  • Jinlin Guo
    • 1
  • Songyang Lao
    • 1
  • Jue Li
    • 1
  1. 1.School of Information System and ManagementNational University of Defense TechnologyChangshaChina

Personalised recommendations