Skip to main content
SpringerLink
Log in

Recognition of identical twins based on the most distinctive region of the face: Human criteria and machine processing approaches

Multimedia Tools and Applications volume 80, pages 15765–15802 (2021)Cite this article

Abstract

Face recognition domain has been well advanced and has achieved high accuracies in identification of individuals in recent years. But in practice, distinguishing similar faces such as an identical twin still is a great challenge for face recognition systems. It happens due to very small differences in the facial features of them. Therefore, extracting common face features is not proper for differentiating identical twins. A solution to this problem is to find the most distinctive regions in the face of identical twins. In this paper, two procedures used to find these specific regions: 1) Machine Processing: A Modified SIFT (M-SIFT) algorithm has been implemented on Identical twins’ face images. Each face image has been segmented into five regions contain eyes, eyebrows, nose, mouth, and face curve. The location and number of mismatched keypoints represented the most distinctive face region in the face of identical twins. 2) Crowdsourcing: We have recognized differences between identical twins faces from human criteria viewpoint by enlisting crowd intelligence. Several questionnaires were designed and completed by 120 participants. The dataset of this study collected by ourselves and include 650 images for 115 pairs of identical twins and 120 non-twin individuals. The results of Machine Processing and Crowdsourcing methods showed that the face curve is the most discriminant region among every five regions in most of identical twins. Several features proposed and extracted based on the keypoints of the M-SIFT algorithm and face landmarks. The experimental results demonstrated the lowest equal error rate of identical twins recognition as 7.8, 8.1 and 10.1% for using the whole images, only frontal images and only images with PAN motions, respectively.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Notes

  1. https://sshmousavi.github.io/dlfr/

References

  1. Abudarham N, Shkiller L, Yovel G (2019) Critical features for face recognition. Cognition 182:73–83

    Article  Google Scholar 

  2. Afaneh A, Noroozi F, Toygar Ă– (2017) Recognition of identical twins using fusion of various facial feature extractors. EURASIP J Image Video Process 2017(1):81

    Article  Google Scholar 

  3. Ahmad B, Usama M, Lu J, Xiao W, Wan J, Yang J (2019) Deep convolutional neural network using triplet loss to distinguish the identical twins. In: IEEE Globecom Workshops (GC Wkshps), Waikoloa, pp 1–6

  4. Biswas S, Bowyer KW, Flynn PJ (2011) A study of face recognition of identical twins by humans. IEEE International Workshop on Information Forensics and Security, Iguacu Falls, pp 1–6

  5. Bowyer KW, Flynn PJ (2016) Biometric identification of identical twins: A survey. In: IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS), Niagara Falls, pp 1–8

  6. Brabham DC (2008) Crowdsourcing as a model for problem solving: an introduction and cases. Convergence 14(1):75–90

    Article  Google Scholar 

  7. Chai D, Ngan KN (1999) Face segmentation using skin-color map in videophone applications. IEEE Trans Circ Syst Video Technol 9(4):551–564

    Article  Google Scholar 

  8. Chen C, Dantcheva A, Swearingen T, Ross A (2017) Spoofing faces using makeup: An investigative study. In: IEEE International Conference on Identity, Security and Behavior Analysis (ISBA), New Delhi, pp 1–8

  9. Dal Martello MF, Maloney LT (2006) Where are kin recognition signals in the human face? J Vis 6(12):1356–1366

    Article  Google Scholar 

  10. detect-eyes-nose-lips-jaw-dlib-opencv-python. 2017 May 2, 2019]; Available from: https://www.pyimagesearch.com/2017/04/10/detect-eyes-nose-lips-jaw-dlib-opencv-python/.

  11. Devi HS, Laishram R, Thounaojam DM (2015) Face recognition using R-KDA with non-linear SVM for multi-view database. Procedia Comput Sci 54:532–541

    Article  Google Scholar 

  12. Eskandari M, Toygar Ö (2015) Selection of optimized features and weights on face-iris fusion using distance images. Comput Vis Image Underst 137:63–75

    Article  Google Scholar 

  13. Hezil N, Boukrouche A (2017) Multimodal biometric recognition using human ear and palmprint. IET Biom 6(5):351–359

    Article  Google Scholar 

  14. Howe J (2006) The rise of crowdsourcing. Wired Mag 14(6):1–4

    Google Scholar 

  15. [October 5, 2019]; Available from: https://trends.google.com/trends/explore?q=crowd%20sourcing&geo=US

  16. Juefei-Xu F, Savvides M (2013) An augmented linear discriminant analysis approach for identifying identical twins with the aid of facial asymmetry features. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops. Portland, pp 56–63

  17. Kae A, Sohn K, Lee H, Learned-Miller E (2013) Augmenting CRFs with boltzmann machine shape priors for image labeling. IEEE Conference on Computer Vision and Pattern Recognition, Portland, pp 2019–2026

  18. Kalyoncu C, Toygar Ö (2016) GTCLC: leaf classification method using multiple descriptors. IET Comput Vis 10(7):700–708

    Article  Google Scholar 

  19. Kemelmacher-Shlizerman I, Basri R (2010) 3D face reconstruction from a single image using a single reference face shape. IEEE Trans Pattern Anal Mach Intell 33(2):394–405

    Article  Google Scholar 

  20. Klare B, Jain AK (2010) On a taxonomy of facial features. In: Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington, DC, pp 1–8

  21. Klare B, Paulino AA, Jain AK (2011) Analysis of facial features in identical twins. In: International Joint Conference on Biometrics (IJCB), Washington, DC, pp 1–8

  22. Le THN, Luu K, Seshadri K, Savvides M (2012) A facial aging approach to identification of identical twins. In: IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS), Arlington, pp 91–98

  23. Le THN et al (2015) Facial aging and asymmetry decomposition based approaches to identification of twins. Pattern Recogn 48(12):3843–3856

    Article  Google Scholar 

  24. Leng L, Teoh ABJ (2015) Alignment-free row-co-occurrence cancelable palmprint fuzzy vault. Pattern Recogn 48(7):2290–2303

    Article  Google Scholar 

  25. Leng L, Zhang J, Xu J, Khan MK, Alghathbar K (2010) Dynamic weighted discrimination power analysis in DCT domain for face and palmprint recognition. International Conference on Information and Communication Technology Convergence (ICTC), Jeju, pp 467–471

  26. Leng L et al. (2010) Dynamic weighted discrimination power analysis in DCT domain for face and palmprint recognition. In: 2010 international conference on information and communication technology convergence (ICTC). IEEE

  27. Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimed Tools Appl 76(1):333–354

    Article  Google Scholar 

  28. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  29. Mahalingam G, Ricanek K (2013) Investigating the effects of gender and age group based differences in identical twins. In: Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Jodhpur, pp 1–4

  30. Mozaffari S, Behravan H (2011) Twins facial similarity impact on conventional face recognition systems. In: 19th Iranian Conference on Electrical Engineering, Tehran, pp 1–6

  31. Nafees M and Uddin J (2018) A twin prediction method using facial recognition feature. In: International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2), Rajshahi, pp 1–4

  32. Paone JR, Flynn PJ, Philips PJ, Bowyer KW, Bruegge RWV, Grother PJ, Quinn GW, Pruitt MT, Grant JM (2014) Double trouble: differentiating identical twins by face recognition. IEEE Trans Inf Forensics Secur 9(2):285–295

    Article  Google Scholar 

  33. Park U, Tong Y, Jain AK (2010) Age-invariant face recognition. IEEE Trans Pattern Anal Mach Intell 32(5):947–954

    Article  Google Scholar 

  34. Park YH, Tien DN, Lee HC, Park KR, Lee EC, Kim SM, Kim HC (2011) A multimodal biometric recognition of touched fingerprint and finger-vein. International Conference on Multimedia and Signal Processing, Guilin, Guangxi, pp 247–250

  35. Peng J, El-Latif AAA, Li Q, Niu X (2014) Multimodal biometric authentication based on score level fusion of finger biometrics. Optik 125(23):6891–6897

    Article  Google Scholar 

  36. Phillips PJ, Flynn PJ, Bowyer KW, Bruegge RWV, Grother PJ Quinn GW, Pruitt M (2011) Distinguishing identical twins by face recognition. In: IEEE International Conference on Automatic Face & Gesture Recognition. FG, Santa Barbara, pp 185–192

  37. Phillips PJ, Flynn PJ, Bowyer KW, Bruegge RWV, Grother PJ Quinn GW, Pruitt M (2011) Distinguishing identical twins by face recognition. In: IEEE International Conference on Automatic Face & Gesture Recognition. FG, Santa Barbara, pp 185–192

  38. Priya L, Rani MP (2017) Authentication of identical twins using tri modal matching. World Congress on Computing and Communication Technologies (WCCCT), Tiruchirappalli, pp 30–33

  39. Pruitt MT, Grant JM, Paone JR, Flynn PJ, Bruegge RWV (2011) Facial recognition of identical twins. International Joint Conference on Biometrics (IJCB), Washington, DC:1–8

  40. Segundo MP et al (2010) Automatic face segmentation and facial landmark detection in range images. IEEE Trans Syst Man Cybern Part B (Cybern) 40(5):1319–1330

    Article  Google Scholar 

  41. Srinivas N, Aggarwal G, Flynn PJ, Vorder Bruegge RW (2012) Analysis of facial marks to distinguish between identical twins. IEEE Trans Inf Forensics Secur 7(5):1536–1550

    Article  Google Scholar 

  42. Sun Z, Paulino AA, Feng J, Chai Z, Tan T, Jain AK (2010) A study of multibiometric traits of identical twins. In: Biometric technology for human identification Vii (Vol0 7667, p 76670T)

  43. Sun X, Torfi A, Nasrabadi N (2018) Deep siamese convolutional neural networks for identical twins and look-alike identification. In: Deep Learning in biometrics, p 65

  44. Fleenor JW (2006) The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economics, societies and nations. Pers Psychol 59(4):955–990

  45. Tharwat A, Ibrahim AF, Ali HA (2012) Multimodal biometric authentication algorithm using ear and finger knuckle images. In: Seventh International Conference on Computer Engineering & Systems (ICCES), Cairo, pp 176–179

  46. Vijayan V, Bowyer KW, Flynn PJ, Huang D, Chen L, Hansen M, Ocegueda O, Shah SK, Kakadiaris IA (2011) Twins 3D face recognition challenge. In: International Joint Conference on Biometrics (IJCB), Washington, DC, pp 1–7

  47. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  48. Wang M, Deng W (2018) Deep visual domain adaptation: a survey. Neurocomputing 312:135–153

    Article  Google Scholar 

  49. Wu Y, Ji Q (2019) Facial landmark detection: a literature survey. Int J Comput Vis 127(2):115–142

    Article  Google Scholar 

  50. Xiao S, Yan S, Kassim AA (2015) Facial landmark detection via progressive initialization. IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, pp 986–993

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University of Zanjan, Zanjan, Iran

    Shokoufeh Mousavi & Mostafa Charmi

  2. Department of Computational Neuroscience, Dade Pardazi Shenakht Mehvare Atynegar Institute, Tehran, Iran

    Hossein Hassanpoor

Authors
  1. Shokoufeh Mousavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mostafa Charmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hossein Hassanpoor
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mostafa Charmi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mousavi, S., Charmi, M. & Hassanpoor, H. Recognition of identical twins based on the most distinctive region of the face: Human criteria and machine processing approaches. Multimed Tools Appl 80, 15765–15802 (2021). https://doi.org/10.1007/s11042-020-10360-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10360-3

Keywords

search

Navigation