Skip to main content
SpringerLink
Log in

Cross-resolution face identification using deep-convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Low resolution (LR) and very low resolution (VLR) face images captured by surveillance cameras make automatic face recognition (AFR) a challenging task. The performance of an automatic face recognition system (AFRS) degrades when these types of face images are compared with high resolution (HR) gallery images. This paper has presented a face identification system called Cross-Resolution Face Identification System, to address this issue. It makes use of the Deep Convolutional Neural Network (DCNN) having different pooling operations to extract resolution robust features from high resolution, low resolution and very low resolution face images. The proposed system is evaluated on four face databases, namely, the ORL, the extended Yale face B, the LFW, and the Georgia Tech under three cross resolution environmental conditions based on resolution of probe images (i.e., high resolution to high resolution, low resolution to high resolution, and very low resolution to high resolution).The experimental outcomes exhibit the effectiveness of the proposed face identification system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2D and 3D face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906

    Article  Google Scholar 

  2. Ahmed A, Guo J, Ali F, et al (2018) LBPH based improved face recognition at low resolution. In:International Conference on Artificial Intelligence and Big Data (ICAIBD) pp. 144-147. IEEE.

  3. Alobaidi T, Mikhael W B (2018) A wavelet domain implementation of sparse representation method for face recognition. In 2018 IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS) pp. 214-217. IEEE

  4. Anas IY, Bamgbose BO, Nuhu S (2019) A comparison between 2D and 3D methods of quantifying facial morphology. Heliyon 5(6):e01880

    Article  Google Scholar 

  5. Arya K V, Rajawat A, Pandey M K, Rajput S S (2017) Very low resolution face recognition using fused visual and texture features. In: Conference on Information and Communication Technology (CICT) pp. 1-5. IEEE.

  6. Best-Rowden L, Han H, Otto C, Klare BF, Jain AK (2014) Unconstrained face recognition: identifying a person of interest from a media collection. IEEE Trans Inf Forensics Secur 9(12):2144–2157

    Article  Google Scholar 

  7. Bhatt HS, Singh R, Vatsa M, Ratha NK (2014) Improving cross-resolution face matching using ensemble-based co-transfer learning. IEEE Trans Image Process 23(12):5654–5669

    Article  MathSciNet  Google Scholar 

  8. Bronstein AM, Bronstein MM, Kimmel R (2003) Expression-invariant 3D face recognition. In: International conference on audio-and video-based biometric person authentication. Springer, Berlin, Heidelberg, pp 62–70

    Chapter  Google Scholar 

  9. Chang KI, Bowyer KW, Flynn PJ (2006) Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans Pattern Anal Mach Intell 28(10):1695–1700

    Article  Google Scholar 

  10. Cirrincione G, Marcolin F, Spada S, Vezzetti E (2017) Intelligent quality assessment of geometrical features for 3D face recognition. In: Italian workshop on neural nets. Springer, Cham, pp 153–164

    Google Scholar 

  11. Coşkun M, Uçar A, Yildirim Ö, Demir Y (2017) Face recognition based on convolutional neural network. In: International Conference on Modern Electrical and Energy Systems (MEES) pp. 376-379. IEEE.

  12. Cristóbal G, Gil E, Šroubek F, et al (2008) Super resolution imaging: a survey of current techniques. In: Advanced Signal Processing Algorithms, Architectures, and Implementations XVIII (Vol. 7074), 70740C. International Society for Optics and Photonics.

  13. Datta Rakshit R, Nath SC, Kisku DR (2017) An improved local pattern descriptor for biometrics face encoding: a LC–LBP approach toward face identification. J Chin Inst Eng 40(1):82–92

    Article  Google Scholar 

  14. Datta Rakshit R, Nath SC, Kisku DR (2018) Face identification using some novel local descriptors under the influence of facial complexities. Expert Syst Appl 92:82–94

    Article  Google Scholar 

  15. Dhar P, Alavi A (2017) Analysis of adaptability of deep features for verifying blurred and cross-resolution images. In 2017 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA) (pp. 1-8). IEEE.

  16. Ding C, Bao T, Karmoshi S, & Zhu M (2017) Low-resolution face recognition via convolutional neural network. In: IEEE 9th International Conference on Communication Software and Networks (ICCSN) pp. 1157-1161. IEEE.

  17. Ebrahimpour R, Sadeghnejad N, Amiri A, Moshtagh A (2010) Low resolution face recognition using combination of diverse classifiers. In International Conference of Soft Computing and Pattern Recognition pp. 265-268. IEEE.

  18. Elazhari A, & Ahmadi M (2013) Interpolation of low resolution images for improved accuracy in human face recognition. In: IEEE 20th International Conference on Electronics, Circuits, and Systems (ICECS) pp. 425-428. IEEE.

  19. Elazhari A, & Ahmadi M (2014) A neural network based human face recognition of low resolution images. In: World Automation Congress (WAC) pp. 185-190. IEEE.

  20. ElSayed A, Mahmood A, Sobh T (2017) Effect of super resolution on high dimensional features for unsupervised face recognition in the wild. In 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) pp. 1-5. IEEE

  21. Freeman WT, Pasztor EC, Carmichael OT (2000) Learning low-level vision. Int J Comput Vis 40(1):25–47

    Article  Google Scholar 

  22. Fu T C, Chiu W C, & Wang Y C F (2017) Learning guided convolutional neural networks for cross-resolution face recognition. In: IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP) 2017, pp. 1-5. IEEE.

  23. Ganguly S, Bhattachaijee D, Nasipuri M (2015). 3D face recognition from complement component range face images. In 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS) pp. 275–278. IEEE.

  24. Gaston J, Ming J, Crookes D (2018) Matching larger image areas for unconstrained face identification. IEEETtrans Cybern 49(8):3191–3202

    Article  Google Scholar 

  25. Hennings-Yeomans P H, Baker S, & Kumar B V (2008) Simultaneous super-resolution and feature extraction for recognition of low-resolution faces. In: IEEE Conference on Computer Vision and Pattern Recognition 2008, pp. 1-8. IEEE (2008).

  26. Huang G B, Mattar M, Berg T, & Learned-Miller E (2008) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In Workshop on faces in 'Real-Life' Images: detection, alignment, and recognition.

  27. Huang T, & Yang J (2010) Image super-resolution: historical overview and future challenges. In: Super-resolution imaging, 19-52. CRC Press.

  28. Jain AK, Li SZ (2011) Handbook of face recognition. Springer, New York

    MATH  Google Scholar 

  29. Jiang J, Hu R, Wang Z, Cai Z (2016) CDMMA: coupled discriminant multi-manifold analysis for matching low-resolution face images. Signal Process 124:162–172

    Article  Google Scholar 

  30. Jiao J, Zheng W S, Wu A, Zhu X, Gong S (2018) Deep low-resolution person re-identification. In Thirty-second AAAI conference on artificial intelligence.

  31. Kasemsumran P, Auephanwiriyakul S, & Theera-Umpon N (2016) Face recognition using string grammar fuzzy K-nearest neighbor. In 2016 8th International Conference on Knowledge and Smart Technology (KST) pp. 55-59. IEEE

  32. Kim KI, Kwon Y (2010) Single-image super-resolution using sparse regression and natural image prior. IEEE Trans Pattern Anal Mach Intell 32(6):1127–1133

    Article  Google Scholar 

  33. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Article  Google Scholar 

  34. Li YJ, Chen YC, Lin YY, Du X, Wang YCF (2019) Recover and identify: a generative dual model for cross-resolution person re-identification. In Proceedings of the IEEE International Conference on Computer Vision pp. 8090–8099.

  35. Lu Z, Jiang X, Kot A (2017) A novel LBP-based color descriptor for face recognition. In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP) pp. 1857-1861. IEEE

  36. Lu Z, Jiang X, Kot A (2018) Deep coupled resnet for low-resolution face recognition. IEEE Signal Process Lett 25(4):526–530

    Article  Google Scholar 

  37. Lui Y M, Bolme D, Draper B A, et al (2009) A meta-analysis of face recognition covariates. In: IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems 2009, pp. 1-8. IEEE.

  38. Maafiri A, Chougdali K (2019) Face recognition using wavelets based feature extraction and PCA-L1 norm. In 2019 International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN) pp. 1-4. IEEE

  39. Massoli FV, Amato G, Falchi F (2020) Cross-resolution learning for face recognition. Image Vis Comput 103927

  40. Mudunuri SP, Biswas S (2016) Low resolution face recognition across variations in pose and illumination. IEEE Trans Pattern Anal Mach Intell 38(5):1034–1040

    Article  Google Scholar 

  41. Nakada M, Wang H, Terzopoulos D (2017) AcFR: active face recognition using convolutional neural networks. Proc IEEE Conf Comput Vis Pattern Recogn Work 2017:35–40

    Google Scholar 

  42. Nguyen HV, Bai L (2010) Cosine similarity metric learning for face verification. In: In: Asian conference on computer vision 2010. Springer, Berlin, Heidelberg, pp 709–720

    Google Scholar 

  43. Nguyen-Quoc H, Hoang V T (2020) Face recognition based on selection approach via canonical correlation analysis feature fusion. In 2020 Zooming Innovation in Consumer Technologies Conference (ZINC) pp. 54-57. IEEE

  44. Park SC, Park MK, Kang MG (2003) Super-resolution image reconstruction: a technical overview. IEEE Signal Process Mag 20(3):21–36

    Article  Google Scholar 

  45. Parkhi O M, Vedaldi A, Zisserman A (2015) Deep face recognition. In: BMVC 2015 (Vol. 1, no. 3, p. 6).

  46. Paysan P, Knothe R, Amberg B, Romdhani S, Vetter T (2009). A 3D face model for pose and illumination invariant face recognition. In 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance pp. 296-301. IEEE.

  47. Rajput S S, Arya K V (2020) CNN classifier based low-resolution face recognition algorithm. In 2020 International Conference on Emerging Frontiers in Electrical and Electronic Technologies (ICEFEET) pp. 1-4. IEEE.

  48. Samaria FS, Harter AC (1994) Parameterization of a stochastic model for human face identification. Proceedings of IEEE Work Appl Comput Vis 1994:138–142

    Google Scholar 

  49. Shakeel M S (2016) Recognition of low-resolution face images using sparse coding of local features. In: Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) 2016, pp. 1-5. IEEE.

  50. Singh M, Nagpal S, Vatsa M, Singh R, Majumdar A (2018) Identity aware synthesis for cross resolution face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 479–488).

  51. Sun Y, Liang D, Wang X, Tang X (2015) Deepid3: face recognition with very deep neural networks. arXiv preprint arXiv:1502.00873.

  52. UCSD Repository, (2001) http://vision.ucsd.edu/∼leekc/Ext Yale database/ExtYaleB.Html

  53. Van Ouwerkerk JD (2006) Image super-resolution survey. Image Vis Comput 24(10):1039–1052

    Article  Google Scholar 

  54. Vezzetti E, Marcolin F (2014) 3D Landmarking in multiexpression face analysis: a preliminary study on eyebrows and mouth. Aesthet Plast Surg 38(4):796–811

    Article  Google Scholar 

  55. Wang Z, Miao Z, Wu QJ, Wan Y, Tang Z (2014) Low-resolution face recognition: a review. Vis Comput 30(4):359–386

    Article  Google Scholar 

  56. Xu K, Wang X, Hu Z, Zhang Z (2019) 3D face recognition based on twin neural network combining deep map and texture. In 2019 IEEE 19th International Conference on Communication Technology (ICCT) pp. 1665-1668. IEEE.

  57. Yang F, Yang W, Gao R, Liao Q (2018) Discriminative multidimensional scaling for low-resolution face recognition. IEEE Signal Process Lett 25(3):388–392

    Article  Google Scholar 

  58. Zeng D, Chen H, Zhao Q (2016) Towards resolution invariant face recognition in uncontrolled scenarios. In 2016 International Conference on Biometrics (ICB) pp. 1-8. IEEE

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, Asansol Engineering College, Asansol, West Bengal, 713305, India

    Rinku Datta Rakshit

  2. Department of Computer Science and Engineering, National Institute of Technology Durgapur, Durgapur, West Bengal, 713209, India

    Dakshina Ranjan Kisku

  3. GLA University, Mathura, India

    Phalguni Gupta

  4. Department of of Computer Science and Engineering, Jadavpur University, Kolkata, WB, 700032, India

    Jamuna Kanta Sing

Authors
  1. Rinku Datta Rakshit
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dakshina Ranjan Kisku
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Phalguni Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jamuna Kanta Sing
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dakshina Ranjan Kisku.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rakshit, R.D., Kisku, D.R., Gupta, P. et al. Cross-resolution face identification using deep-convolutional neural network. Multimed Tools Appl 80, 20733–20758 (2021). https://doi.org/10.1007/s11042-021-10745-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10745-y

Keywords

Search

Navigation